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VERTEX-REINFORCED RANDOM WALK ON Z EVENTUALLY 
GETS STUCK ON FIVE POINTS 1 

By Pierre Tarres 

CNRS, Universite Paul Sabatier and Universite de Neuchdtel 

Vertex-reinforced random walk (VRRW), defined by Pemantle in 
1988, is a random process that takes values in the vertex set of a 
graph G, which is more likely to visit vertices it has visited before. 
Pemantle and Volkov considered the case when the underlying graph 
is the one-dimensional integer lattice Z. They proved that the range 
is almost surely finite and that with positive probability the range 
contains exactly five points. They conjectured that this second event 
holds with probability 1. The proof of this conjecture is the main 
purpose of this paper. 

1. General introduction. Let (Q, T, P) be a probability space. Let G be a 
locally finite graph, let ~ be its neighbor relationship and let V{G) be its ver- 
tex set. Let (X n ) ne pj be a process that takes values in V(G). Let F = (T n ) n ^ 
denote the filtration generated by the process [i.e., T n = ct(Xq, . . . ,X n ) for 
all n G N] and let Too = &(T n ,n > 0). 

For any v G V(G), let Z n {v) be the number of times plus 1 that the process 
visits site v up through time n £ N U {oo}, that is, 



Z n (v) = ! + 



{Xi=v}- 



Then (X n ) ng N is called vertex-reinforced random walk (VRRW) with start- 
ing point vq G V(G) if Xq = vq and for all n G N, 

F(X n+1 = x\T n ) = i {x ^ n} _-^L_. 
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In other words, moves are restricted to the edges of G, with the probability 
of a move to a neighbor x being proportional to the augmented occupation 
Z n {x) of x at that time. 

VRRWs were introduced in 1988 by Pemantle [7] in the spirit of the 
seminal work by Coppersmith and Diaconis [4], who defined the notion of 
edge-reinforced random walks, which have at each step a probability to move 
along an edge proportional to the number of times plus 1 that the process 
has visited this edge. Reinforced processes are useful in models involving 
self-organization and learning behavior; they can also describe spatial mo- 
nopolistic competition in economics. For more details on applications and 
known results in connection with these models, refer to the articles by Pe- 
mantle and Volkov [8, 9]. 

VRRWs on finite complete graphs, with reinforcements weighted by fac- 
tors associated to each edge of the graph, have been studied by Pemantle [8] 
and Benam [1]. Pemantle and Volkov obtained results in 1997 on reinforced 
random walks on Z [9], which are described in the following text. More re- 
cently, Volkov [13] generalized some of these results and proved that, on a 
fairly broad class of locally finite graphs (containing the graphs of bounded 
degree) , the VRRW has finite range with positive probability. The remainder 
of this paper is devoted to VRRWs on Z. 

Define the two random sets 

R:={v eZ/3n£N s.t. X n = v}, 
R :={u£ Z/X n = v infinitely often} 
and, given k 6 Z and a G (0, 1), define the six events: 

1. {R' = {k-2,k-l,k,k + l,k + 2}}; 

2. {hi Z n (k - 2)/ Inn ^ a}; 

3. {lnZ n (fc + 2)/lnn-> 1 -a}; 

4. {Z„(fc-l)/n->a/2}; 

5. {Z n (fc + l)/n->(l-a)/2}; 

6. {Z n {k)/n^ 1/2}. 

Let | • | be the cardinality of a set. Pemantle and Volkov [9] proved the 
following results. 

Theorem 1.1. One has P(\R\ < oo) = 1 and P(\R\ = 5) > 0. 

Theorem 1.2. One has P(\R'\ < 4) = 0. 

Theorem 1.3. For any open set I C [0, 1] and any integer k G Z there 
exists, with positive probability, a £ I such that events 1-6 occur. 

Pemantle and Volkov also proposed the following conjecture. 
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Conjecture 1. There exist almost surely fcGZ and a G (0, 1) such that 
events 1-6 occur. 

The main purpose of the present article is to prove this conjecture. In 
fact, we prove the following result, which is slightly more accurate. Given 
Ci, C2 G (0,oo) and k G Z, define the two events: 



Theorem 1.4. There exist almost surely k G Z, a G (0, 1) and Ci, C2 G 
(0,oo) suc/i i/tai events 1, 2', 3' and 4-6 occur. 

In our proof, we make use of Theorem 1.1 of Pemantle and Volkov ([9]; 
stated above). The heuristic developed by these authors on the comparison 
of VRRW to Polya and Friedman urn models [9, 13] also has been very useful 
and is partly related to the results claimed in Section 3.1. Although we do 
not use it explicitly, the heuristic of a result from Benam about convergence 
with positive probability toward an attractor ([2], Chapter 7) has been very 
useful in Lemmas 2.4, 2.9 and 2.11. 

2. Introduction to the ideas of the proof. 

2.1. Notation. Let W = R \ {0}, N* = N \ {0}, W + = R + \ {0} and = 
Q + \ {0}. Given a random sequence (7™) of F-adapted nondecreasing stop- 
ping times (Vg G N, {j n <q}£F q ), let F (7n)ngN = (J^" 7n ) ngN denote the filtra- 
tion defined as follows: For all n G N, A G T ln VgeNU {00}, A n {j n < 
q} G J- q . The equalities and inclusions between probability events are under- 
stood to hold almost surely. Given x, y G ffi, we use alternately the notation 
x Ay and mm(x,y) [resp. x V y and max(x,y)] for the minimum [resp. the 
maximum] of x and y. We write x = iff \x\ < y. We let x + = max(x,0) 
and x~ = max(— x, 0). Let Cst(ai, 02, . . . , a p ) denote a positive constant de- 
pending only on a%, 02, . .. ,Op and let Cst denote a universal positive con- 
stant. We say for simplicity that a property holds for x < Cst(ai, . . . ,a p ) 
[resp. for x > Cst(ai, . . . , a p )] when there exists a constant c, which depends 
only on a±, . . . ,a p so that this property holds for x < c (resp. for x > c). 

Let (« n )neN and ("y n )neN be two sequences taking values in M. We write 
Un = 0{v n ) [resp. u n = o(v n )] when there exists an a.s. finite random vari- 
able C [resp. a random sequence (C n ) ne N converging to a.s.] such that, for 
all n £ N, u n < Cv n [resp. u n < C n v n \. 

We write u n x v n iff either limsup \ u n \ < 00 and limsup \v n \ < 00 or u n /v n — ► 1, 
and write u n ■< v n iff, for all e > 0, there exists &o G N such that, for all 
n > k > ko , 



2'. Z n (k-2)/n' 
3'. Z n {k + 2)/n 



a 




Cr, 



c 2 . 



«n - ^fc < (1 +£){Vn ~ Vk)+S. 



4 



P. TARRES 



Note that, if u n and v n are random variables, ko is a priori a random variable. 

Similarly, given a£R and another sequence (f«n)neN that takes values in 
R, we write u n < Wn > a v n when, for all e > 0, there exists ko G N such that, 
for all n>k>ko, 

Un — Uk < (1 + e)(f n . — Vk) + e if w m > a for all m G [fc, n]. 

We write u n = u n iff lim(w n — v n ) exists a.s. and is finite, and write u n = v n iff 
there exists a random ko G N such that for all n>ko, u n — v n = Uk — Vk ■ In 
particular, we write u n = v n + o(w n ) iff there exists a£l(a priori random) 
such that u n — v n = a + o(w n ). Given u, v G U {oo}, we write u « v iff 
either u = v = oo or max(u,f) < oo, and write u >z v iff either u = oo or 
max(u, u) < oo. 

We let E[-] and V[-] be the expectation and the variance of a random 
variable. If Q is a sub-cr-field of J-, we let and V[-|^] be the expectation 

and variance conditionally to Q. 

2.2. Sketch of the proof. Let us begin with some background on the study 
of VRRWs. First recall that VRRW are non-Markovian processes. Define, 
for all n G N, the vector of occupation densities of the random walk at time 

n as 



The works of Pemantle [8] and Benam [1] provide some methods to com- 
pare the behavior of V(n) with solutions of ordinary differential equations 
when the graph is complete (i.e., any two vertices and adjacent). The heuris- 
tics of these results is as follows. 

Let L>1. For all n G N, try to compare V{n + L) to V(n). If n ^> L, then 
the VRRW between these times behaves as though V were constant and, 
hence, approximates a Markov chain which we call M(V(n)). Let Tr(V(n)) 
be the invariant measure of M(V(n)). If L is assumed to be large enough, 
then the occupation measure between these times will be close to ir(V(n)). 
This means that, approximately, 




(1) 



(n + L)V{n + L)= nV{n) + Lvr(V(n)); 



hence 



(2) 



V{n + L) - V{n) = {L/n){ir(V(n)) - V[n)). 



Passing to a continuous time limit gives 



(3) J v it ) = - {7T (V(t))-V{t)). 
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Up to an exponential time change, V should behave like an integral curve 
for the vector field tt — I. 

If the graph is not assumed to be complete, then the relaxation time of 
the Markov chain M(V(n)) depends on V(n), (1) and (2) do not make sense 
in general, and it is difficult to deduce some results from this heuristics. In 
the critical case where this relaxation time is on the order of n, it may occur 
that the random walk gets stuck with high probability in a proper subset of 
the graph. 

Our work relies on the principle that, on Z, when this relaxation time 
is large, there are some seldom visited vertices between some often visited 
vertices. In this case, the behavior of the occupation densities of the random 
walk can be studied nearly independently to the left and to the right of each 
seldom visited vertex. 

This notion of asymptotically seldom visited vertex x £ Z corresponds, in 
the following notation, to event T(x) defined below. For x 6 Z and n 6 N, 
denote 

n 

%n( x ) : = 1 {X k - 1 =x,X k =x±l}, 
k=l 

n 1 

Y n (x) := g Hx k - 1 = x}Zk _ i{x _ l) + Zk _ i{x + l y 



k=l 

n 



1 



Y n( x ) '■- 1 {X k -. 1 =x,Xk=x±l}-^ (V + lV 

fe=l k ~ 1[ - > 

±, \ _ Z n (x±l) , Z n (x±l) 

an{Xh Z n (x-l) + Z n (x + iy Pn{X) - Z n {x) 

n 1 

y±(x) := g i { x t _ 1= ,±u fc =x} Zk _ i{x ± x) , 

n * 

k=i Zk ^ x > 



Since, for any fixed x € Z, the sequences Z n (x), Y n (x), Y^(x), Y^{x) and 
Y^{x) are monotone nondecreasing in n, it makes sense to denote 

r±f„\ — lim 7±, 
n— »oo 

— lim vz 

71— »00 



Zoo{x) := lim^Z n (x), Z±(x) := lim^Z^x), 
Y^x) := lim Y n (x), Y±(x) := lim Y±{x\ 



Y±(x) := Hm ?±(x) := lim Y±(x). 

Let us define the probability events 
T(x) :={y oo (x)<oo}, 
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T-(x) := {Y~(x) < oo}, T+(x) := {Y+(x) < oo}. 

Let us enumerate a few properties about these events T(x), First, for 

all 16Z, T(x) coincides a.s. with the set T + (x) on which there are a small 
number of visits from itoi + 1 and, by symmetry, with the set T~(x). This 
property is stated in the following lemma. 

Lemma 2.1. ForallxGZ, 

r(x) = r+(x) = ?-(x). 

Proof. Using the conditional Borel-Cantelli lemma [Lemma A.l(i)], 



oo 



< OO 



Ife L Zk-i(x±i) 

= {£ Hx k ^= x} Zk i{x _ 1} ; ^ - 1} < 00} = t ( x). n 

Second, there are at most two consecutive infinitely often visited sites 
x £ Z on which T(x) holds, as implied by Lemma 2.2. 

Lemma 2.2. ForallxGZ, 

T(x - 1) n T(z + 1) = {Z^x) < 00}. 

Proof. Indeed, by Lemma 2.1, 

T(i-i)nT(i + i) 

= T+(i-i)nr(i+i) 

{00 1 ~l 
ln^ 00 (x)«^^^i = y+(x-l)+y-(x-l)<oo 

= {Zoo(x) < OO}. 

The reverse inclusion is straightforward. □ 

Third, if T(x) holds, we can give some information on the behavior of 
a~(x + 2) (since there are a small number of visits from x to x + 1) as 
stated in Corollary 3.1(h). Note that the entire Corollary 3.1 is stated (and 
proved) in Section 3.1. 
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Corollary 3.1 (ii). For all x G Z ; 

T(x) C ha^(x±2) := lim aj(x±2) G [0,1)1. 

n — >oo J 

Fourth, we can claim a kind of propagation rule on seldom visited sites 
as given by the following proposition. 

Proposition 2.1. For all ieZ, 

T(x) cT(x + l)UT(x + 4). 

This result is closely related to the dynamics inherent to the random 
walk. We cannot directly use the methods of comparison with the dynamical 
system, since there is no tool that gives a control on the behavior of the 
random walk on more than a few vertices. 

The heuristic of the proposition is that there is a kind of competition 
between the numbers of visits to points x + 1 and x + 4. Its proof is divided 
into two cases. If a^(x + 2) is positive, then x + 4 loses, which implies that 
Y(x + 4) holds. On the other hand, if a7 y0 (x + 2) is equal to zero, then x + 1 
loses, which implies that Y(x + 1) holds. These two results are implied, 
respectively, by Corollary 3.1 (hi) and Lemma 2.3: 



Corollary 3.1 (hi). For all x G Z, 

T(x) n {a~ (x + 2) > 0} C T(x + 4). 



Lemma 2.3. For all x G Z, 

T(x) n {a~ (x + 2) = 0} C T(x + 1). 



Recall that Corollary 3.1 is proved in Section 3.1. Lemma 2.3 is equivalent 
to the statement that the random set 

T (x) = T(x) n {a^(x + 2) = 0} n T(x + If 

is of probability 0. Before proving this lemma, we prove in Lemma 2.4 
(proved in Section 3.3) that To(x) is a.s. a subset of T' (x) (defined here- 
after), on which we have a rough control on the behavior of the random 
walk on sites x to x + 5. Then Lemma 2.5 (stated hereafter and proved in 
Section 5.1) completes the proof. 
Let e := exp(l). Let, for all x G Z, 

T' (x) = (hmsup f ra S X + 4 i < el n (limsupf sup a fcj x + 2 j ) < A 
0W I F Z n (x + l)" J I ^\ k >nan(x + 2)J ~ J 
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lnZ n (x + A) 
lnZ n (x + 2) 



= 1 



n {Zoo(x) = Zoo(x + 4) = OO} 





< 1 > n < lim sup 



Z n (x + 2) 



Z n (x) 



< 1 



} 



Lemma 2.4. For all x G Z, T (x) C T' (x). 
Lemma 2.5. For a// x e Z, P(T (x) n T' (x)) = 0. 

The case of To(x) n Tq(x) considered in Lemma 2.5 corresponds to an 
unstable set in the dynamical systems setting. To prove the nonconvergence 
to this set without a complete control on the behavior of the empirical 
density of occupation, we use a partial order on a certain class of random 
walks on Z and prove an appropriate result in some unstable situations 
(Section 4). 

Let us now go back to the description of seldom visited sites. Theorem 1.1 
implies that there exists a.s. a leftmost infinitely visited site Xq. By definition, 
^00(^0 — 1) < 00, which implies that T(xo — 1) and T(xo) = T~(xo) hold 
(using Lemma 2.1). Accordingly, Proposition 2.1 and Lemma 2.2 lead us to 
a pavement of the set of infinitely often visited vertices (which is connected) 
by sites on which T(x) holds. 

More precisely, let us denote, for any finite sequence (xj)i<j< n taking 
values in Z, the event 



O(x) = {x = mfR'}, 
fio(z) = n(x) n {Zooix + 5) < 00}, 

Qi(x) = T(x, x + 4, x + 8) n {Zoo(x + 1) = Z^ix + 7) = 00}, 
n 2 {x) = T(x - 1, x, x + 4, x + 5, x + 9, x + 10) 

n {Zoo(x + 1) = Zoo(x + 8) = OO}. 

We can state the following lemma. 



T((Xi)l<i< n ) = P| T(xj). 



Ki<n 



Let us define the events 



Lemma 2.6. ForallxeZ, 

fi(x) C O (x) U Oi(x) U Oi(x + 5) U Q 2 (x). 
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Proof. First, for all y G Z, 
(4) T(y-l,y)n{Z 00 (y) = oo}cT(y + 4), 

since, by Proposition 2.1, 

T(y)cT(y+l)UT(y + 4) 

and, by Lemma 2.2, 

T(y-l)nT(y + l)c{Z 00 (y)<oo}. 

This implies 

n( x )nn (x) c 

C T(x — l,x) Pi {Z QO (x) = Z oc (x + 5) = oo} 

C T(x — l,x,x + 4) n {^(^(x) = Zoo(x + 5) = oo} 

C (T(x - 1, x + 4, x + 5) U T(x, x + 4, x + 8)) 

n {^(x) = Zoo(a; + 7) = oo}, 

where we use (4) with y := x in the second inclusion and use Proposition 2.1 
with x := x + 4 in the third inclusion [Z^x + 7) = oo follows from the 
convergence of a^(x + 6) on T(x + 4), by Corollary 3.1(h), together with 
Zoo{x + 5) = oo]. 
Now 

T(x — 1, x, x + 4, x + 5) n {Z QO (x + 5) = oo} 

C T(x- l,x,x + 4,x + 5,x + 9) 

C T(x - 1, x, x + 4, x + 5, x + 9, x + 10) 

UT(x- l,x,x + 4,x + 5,x + 9,x + 13), 

where we use (4) with y := x + 5 in the first inclusion and use Proposition 2.1 
with x : = x + 9 in the second inclusion. 

Putting together these two equations, we obtain 

O(x)nO (x) c n^i(x) c 

C T(x - 1, x, x + 4) n {Zoo(x + 1) = Zoo(x + 7) = oo} 

n (T(x + 5,x + 9,x + 10)UT(x + 5,x + 9,x + 13)) 

C n 2 (x) Ufti(x + 5), 

where we note in the second inclusion that Z OQ (x + 8) = oo if T(x + 8) does 
not hold and, similarly, Z OQ (x + 10) = Z QO (x + 12) = oo [since a^ a (x + 11) G 
[0, 1)] on T(x + 9) if T(x + 10) does not hold. □ 

Now, for all x G Z, 0,±(x) and f^C^) are of probability 0, as stated in 
Lemmas 2.7 and 2.8. These results complete the proof of the conjecture. 
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Lemma 2.7. For all x G Z, P(^i(x)) = 0. 
Lemma 2.8. For a// x G Z, P(ft 2 (x)) = 0. 

Let us explain in a few words the proofs of these lemmas. Lemma 2.7 
relies on the fact that there is a kind of competition between the numbers 
of visits to points x + 1, x + 2 and x + 3 on the left-hand side of x + 4, and 
x + 5, x + 6 and x + 7 on the right-hand side of x + 4. We first prove the 
following lemma. 

Lemma 2.9. For all x G Z, Oi(x) C {limZ n (x + 6)/Z n (x + 2) = 1}. 

The heuristic of Lemma 2.9 is that if Z n (x + 6)/Z n (x + 2) did not converge 
to 1, then it would converge to or to oo, and that these convergences would 
be so fast that Z^ix + 6) < oo in the first case and Z^ix + 2) < oo in the 
second case. 

The proof of Lemma 2.7 therefore reduces to the study of the unstable case 
Z n (x + 6)/Z n (x + 2) — ► 1. The methods used for this proof in Section 5.2 rely, 
similarly as in the proof of Lemma 2.5, on the tools introduced in Section 4. 

The proof of Lemma 2.8 has roughly the same heuristic as Lemma 2.7, 
but we have to face the problem explained at the beginning of this section, 
that is, we have to discriminate between the case {a^ (x + 7) > ctQ(x + 2)}, 
where the random walk regularly visits the set {x, . . . , x + 9}, and the case 
{a^ (x + 7) < a^o(x + 2)}, where the random walk eventually gets stuck in a 
strict subset [i.e., Z 00 (x + 4) < oo or Z 00 (x + 5) < oo]. This study corresponds 
to Lemma 2.10, stated subsequently and proved in Section 3.5. 

Lemma 2.10. Forallx£Z, 

Q 2 (x) C {a" (a + 7) > a" (a; + 2)}. 

Next, we prove in Lemma 2.11 that Z n {x + 7) / Z n {x + 2) — ► 1 on ^(x) and 
we finish the proof of Lemma 2.8 in Section 5.3, using again the methods 
introduced in Section 4. 

Lemma 2.11. For all x G Z, Q 2 (x) C {limZ n (x + 7)/Z n (x + 2) = 1}. 

2.3. Outline of contents. Section 3 gives some preliminary results, based 
on martingales techniques. This section is divided into six parts. In Sec- 
tion 3.1, we prove results related to the Polya and Friedman urn models. In 
Section 3.2 we give a comparison tool (Lemma 3.1) and prove an estimate 
that gives conditions for a site to be finitely often visited (Lemma 3.2). Fi- 
nally, we deduce Lemmas 2.4, 2.9, 2.10 and 2.11, respectively, in Sections 
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3.3, 3.4, 3.5 and 3.6. In Section 4, we prove a result of nonconvergence in 
unstable situations, using a partial order on a certain class of random walks 
on Z. This result is useful to the proofs of Lemmas 2.5, 2.7 and 2.8. In Sec- 
tion 5, we apply this result to the proofs of Lemmas 2.5, 2.7 and 2.8 (resp. in 
Sections 5.1, 5.2 and 5.3). In the Appendix, we state some general martin- 
gale results and, in particular, recall a generalized version of the conditional 
Borel-Cantelli lemma. 

3. Preliminary results. 

3.1. Martingale results. The following Proposition 3.1 and its Corollaries 
3.1 and 3.2 provide us withjsome local properties of the VRRW, relating the 
quantities Y n (x), Y^(x), Y^(x) and Y^(x) defined in Section 2.2. These 
results enable us to describe the behavior of the random walk on the first 
few points following x when one event like Tq(x), f2i(x) or ^(x) holds. 

Let us focus on the two key properties of this part, namely Proposi- 
tion 3.1(a) and Corollary 3.2(i), which are related to the Polya and Fried- 
man urn models. Note that a detailed survey on the relationships between 
these urn models and reinforcement processes can be found in [9]. 

Proposition 3.1(a) can be explained by studying first the case of a VRRW 
on three consecutive points {x — l,x,x + 1}. Under this assumption, the 
walk is half of the time in sites x — 1 or x + 1 , and comes back to x at the 
next step; the other half of the time, the walk is in site x and moves to x ± 1 
with a probability equal to the number of times x ± 1 has been visited up 
through time n divided by the total number of visits to x — 1 and x + 1 [with 
the convention that the sites x ± 1 have been visited Zq(x ± 1) at time 0]. 

This construction is equivalent to a Polya urn model with two colors x — 1 
and x + 1, with Z n (x — 1) and Z n (x + 1) balls of colors x — 1 and x + 1 at 
time n. Indeed, this corresponds to the process of picking, half of the time, 
a ball at random in the urn and replacing it with a ball of the same color. 

A classical result claims that the proportion of balls of color x — 1 con- 
verges toward a random a £ (0, 1). The random variable a has a beta dis- 
tribution of parameters Zq(x — 1) and Zq(x + 1) (see, e.g., [5], Vol. 2, Chap- 
ter VII), but this result is difficult to use in our context, where, in the general 
case, we have to deal with visits from x + 2 to x + 1 and from x — 2 to x — 1. 
Observe that this convergence can be proved by Proposition 3.1(a). Indeed, 
it implies that Y+{x) — Y~{x) converges, and we deduce from the conver- 
gence of Y^(x) — lnZ n (x ± 1) (approximation of log by the harmonic series) 
that ln(Z n (x + 1)/Z n (x — 1)) converges. 

Let us now return to the study of the VRRW on Z. The equivalence 
between the weighted numbers of visits from x to x + 1 and from x to x — 1, 
Y+(x) and Y~(x), claimed in Proposition 3.1(a), enables us to estimate 
in Corollary 3.1(i) the variation of lnZ n (x + 1)/Z n (x — 1), with respect to 
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Y~(x + 2) and Y^(x — 2). Corollary 3.1(ii)-(iv) is a direct consequence of 
this claim. 

Let us now explain the heuristic of Corollary 3.2(i). Let us consider the 
case where, given i£Z, the event 

B! = {x — 2,x — l,x,x + l,x + 2} 

holds. Then T~(x — 2) = T(x — 2) and T(x + 2) hold. This implies by Corol- 
lary 3.1(h) that a~(x) converges to a^ Q (x) G (0,1) (see also Remark 3.1). 
Let us study the behavior of the random walk on the border point x — 2. 

Let us denote by t n the nth visit time to site x — 1. We again observe 
an urn model with two colors x — 2 and x, Z tn (x — 2) and Z tn (x) being 
the numbers of balls of color x — 2 and x at the nth iteration. Indeed, at 
time t n , we move to x — 2 with probability otj (x — 1); this operation is 
equivalent to picking a ball at random in the urn, and similarly for x. Now, 
if we move to x — 2, we come back to x — 1 at the next step (unless we move 
to x — 3, which occurs only finitely often). On the other hand, if we move 
to x, the expected number of visits to x before returning to x — 1 is on the 
order of l/a^ a (x) [expectation of a geometric random variable with success 
probability a^ (x)]. 

In the urn model, this means that if we pick a ball of color x — 2, we 
replace it with a ball of the same color, and that if we pick a ball of color 
x, we replace it, on average, by l/a^ {x) balls of color x. This corresponds 
to a generalized Polya-Priedman urn model (see, e.g., [9]), and a classical 
result claims that this implies Zt n (x) ~ Zt n (x — 2) 1 / Q °°( X ). We obtain the 
same conclusion by Corollary 3.2(i) and (iv): 

In Z n (x - 2) = Y~ (x) = a k(°°) = Q i>( x ) ln Z ^ x )~ 

k=i Zk[ - X > 

This gives an intuition for this Corollary 3.2, which is needed here instead of 
generalized Polya-Priedman urn results since the corresponding martingale 
technique is more adaptable to the case of visits from x — 3 to x — 2. 

Note that these methods provide the asymptotic behavior of the VRRW 
on Z, conditional on the event that we eventually get stuck on five points. 
Indeed, we obtain that events 2-6 (defined in Section 1) hold, conditional 
on to event 1. Another proof of this result was given by Bienveniie in his 
Ph.D. dissertation [3], using ideas related to the construction of continuous 
reinforced random walks (see [10]). 

Proposition 3.1. For allxeZ and v < 1/2, 

(a) Y^{x) = Y n {x) + o{Z n {x±\)- v ), 

(b) lnZ n (x) = Y+(x - 1) + Y~(x + 1) + 0{Z n {x)~ x ), 



REINFORCED RANDOM WALK 13 
(c) F±(x) = f±(x) - l^^j/C^-iCs ± 1)) = Y*{x ± 1) + o(Z n (x ± 



1 



Proof. Let us first prove statement (a). Given z/o < 1/2, we apply 
Lemma A.l(iii) with 

T k = {X k _ 1 = x,X k = x±l}, £ k = l/Z k (x±l), /? fc = Z fc (x±l) 2 ^, 
to conclude that 

(5) y n ± (x)-y n (x) = o(z n (x±i)- I '°). 

Indeed, using the notation of this lemma, 



■ OO -jj^ 

g^~g°' ( * W( * W±$-"> 

-^ ak[X) Z k ( X ± 1)2(1-0) -2-r Z,(X± 1)2(1-0) <0 °' 



the last equivalence being a consequence of the conditional Borel-Cantelli 
lemma, Lemma A.l(i). Therefore, the conditions of Lemma A.l(iii) are stat- 
isfied and (5) holds. 

Statement (a) follows directly if Z^^x ± 1) = 00, by choosing vq > v. 
Otherwise, by Lemma A.l(i), Y oc (x) x Y^(x) < 00, which also enables us to 
conclude (a). 

Statement (b) follows from 



It 



Z n (x)-1 



y^-i ) + y-(, + i) = E^^= E 7 

k=1 Z, k _ l{ X) j=l+t{x =x} 

= lnZ n {x) + Cst(x,v ) + □ (Z n (s) _1 ) 

when Z n [x) > Cst. 

Let us now prove statement (c) for Y+(x)\ the proof for Y~(x) is similar. 
For all n£N*, let u n (resp. v n ) be the time of the nth visit from x to x + 1 
(resp. from x + 1 to x), that is, 



u n = inf{£; G N*/Z+(x) = n}, v n = inf{k G N*/Z^(x + 1) = n}. 



Recall that the number of visits (x) from x to x ± 1 at time /c is defined 



in Section 2.1. 

Assume, for instance, «i < ui (the other case is similar). Then, for all 
n G N*, u n < v n+ \ < u n+ \ (with the convention that 00 < 00) and Z„ n _i(x + 
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1) = Z Un _i(x + 1). Therefore, 

Y u n ( x ) - Y uA x ) = zZ 1 {x k _ 1 =x,x k =x+i}y — 7TXTT 

fc=U X +l Z fc _l(X+l) 
n , 

= E 



. =2 Z % ._!(X + 1) 
n -y v„ ^ 



^.^(x + l) k % t^M*^ Zw(l+1) 



= fc E 1 {x fc _ 1=a; +i,x fc =x} z ^ i(x + 1) =y+(g)-y+(a). 

This gives the first equivalence of (c) when u n < oo for all n G N*. Otherwise, 
5j^ + (x) — Y" fc + (x) is constant for large enough k G N, which also gives the 
equivalence. 

Let us prove the second equivalence of (c). If Z QO (x ± 1) < oo, then 
^oo( x ) x ^oo( x ) < oo by Lemma A.l(i), which enables us to conclude. Oth- 
erwise, apply Lemma A.l(iii) and use its notation, with 

T k = {X k _ 1 = x±l,X k = x}, £ k = l/Z k (x±l), (3 k = Z k (x±l) 2u , 

where we note that 

OO OO -ji 



Corollary 3.1. For all x eZ and v < 1/2: 

(i) ln(Z n (x-l))/(Z n (x + l)) = Y+(x-2)-Y-(x + 2) + o(Z n (x-iyn + 
o(Z n {x + l)- v ); 

(ii) T(x) C {3 a* (x ± 2) := lim™ aj(x ± 2) G [0, 1)}; 

(iii) T(x) n {a^(x ± 2) > 0} C T(x ± 4); 

(iv) T(x)c{3/?T( x ±2) : =lim n _ +00 /^(x±2)G [0,oo)}; 

(v) T(x) n {^(x ± 2) = oo} C {/3£(x ± 2) = a£ (x ± 2)}. 



Remark 3.1. Corollary 3.1 implies that a.s. on Y(x,x + 4), a^ : (x + 2) 
[resp. /3„ (x + 2)] converges to a^,(x + 2) G (0, 1) [resp. /^(x + 2) > 0] and 
that /3± (x + 2) = a<± (x + 2) if, moreover, Z^ix + 2) — oo. This follows from 
an application of statements (ii) and (iv)-(v) successively to x with — instead 
of =f and to x + 4 with + instead of =F, and from a^ a (x + 2) + a~ (x + 2) = 1. 
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Proof of Corollary 3.1. It follows from statement (b) of Proposi- 
tion 3.1, applied to x — 1 and x + 1 that, for all v < 1/2, 

Y~(x) = \nZ n (x - 1) - Y+(x - 2) + o(Z n (x - 1)""), 

Y+(x) = In Z n (x + 1) - Y~(x + 2) + o(Z n ,(x + l)""). 

These equivalences remain true in the cases (x — 1) < oo and Z^ (x + 1) < 
oo. 

It also follows from statement (a) of the proposition that, for all v < 1/2, 

Y~(x) = Y+(x) + o(Z n (x - l)~ v ) + o(Z n {x + 1)-*), 

which completes the proof of (i). Let us now prove (ii) and (hi) for a~(x + 2); 
the case of a^(x + 2) is similar. Apply (i) for x + 2: On Y(x), 

In l n f + % = Y+ (x) - Y~ (x + A)^ -Y- (x + 4) 

and Y~{x + 4) is nondecreasing in n, which completes the proof. 

Let us now prove (iv) and (v) for f3~(x + 2); the proof for (3+(x — 2) is 
similar. Assume that T(x) holds: By statements (a) (applied to x + 2) and 
(b) (applied to x + 1) of the proposition, 

lnZ n (x + 1) = y+(x) + Y~(x + 2) 

_ Y n (x + 2) Y n{ x + 2)- ^ Zk{x + 2) _ {x + 2) , 

and, therefore, 

(6) ln/3-(x + 2) = In ^ X + ^ V ( ^ + 2) -l 

Z n (x + 2) ^ Z k {x + 2) \(3-{ x + 2) 

Now, Z k (x + 2) < Z k (x+l) + Z k (x + 3) implies a^(x + 2) <(3 k ~(x + 2). Hence 
the right-hand side of the equation is nonincreasing in n, which implies (iv). 
Let us further assume that Z ao (x + 2) = oo. If /3~ (a; + 2) > and @^ (x + 2) ^ 
a oo ( x + 2) , then o^T (x + 2)//?^ (x + 2) — 1 converges to a negative real and (6) 
implies ln/3^(x + 2) = — oo, so that (3^ {x + 2) = 0, which leads to a contra- 
diction. If /3~ (x + 2) = 0, then q^ (x + 2) < /3^,(x+2) = 0. This completes the 
proof of (v). 

□ 

Corollary 3.2. For all x eZ, 7 e (0, 1) and z/ < 1/2: 

(i) T(x - 1) C {\nZ n {x) = Y~(x + 1) = Y"(x + 2) + o(Z n (x)-")}; 

(ii) T(x-l)n{limsupa~(x + 2) < 7} C T(x- l)n{lnZ n (cc) H 7lnZ n (x + 
2)}cT(x-l,x); 
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(iii) {liminf a~(x + 2) > 7} C {hxZ n (x) h "flnZ n (x + 2)}; 

(iv) T(x- l,x,x + 4,x + 5) C {36 > 0/a~(x + 2) -a~ (x + 2) = o(Z„(x + 
2)~< 5 )} n {lnZ n (x) = a^(x + 2) lnZ n (x + 2) = a~(x + 2) lnZ n (x + 2)}. 

Proof. Let us first prove (i). Assume that Y(x — 1) holds and apply 
Proposition 3.1(a), (b) and (c): For all v < 1/2, 

lnZ„(x) = Y~{x + 1) = Y+(x + 1) + o(Z n (x)- v ) + o(Z n (x + 2)~ v ) 

(7) = f ~(x + 2) + o(Z n (x)- u ) + o(Z n (x + 2)"") 
= y-(x + 2) + o(Z n (x)- y ), 

where we use in the last equation that a~(x + 1) converges to o^(x + 

1) € [0,1) by Corollary 3.1(h) and, therefore, that o{Z n {x + 2)~ u ) is up- 
per bounded by o(Z n (x)~ u ). The first inclusion of statement (ii) and state- 
ment (iii) follow directly. 

Let us prove the second part of (ii). Assume Y(x — 1) n {lnZ n (x) ^ 
y\nZ n (x + 2)} holds. We prove the stronger statement that there exists 5 > 
such that (8) holds, which completes the proof by Lemma 2.1 [Y(x) = Y + (x)] 
and also is useful in the proof of (iv). If Z OQ (x + 1) < 00, then Y+(x) < 00, 
which proves the statement. Otherwise, for all e > 0, for sufficiently large 
ken, using Z k {x + 1) < Z k (x) + Z k (x + 2), 

_/ \ Z k {x) 
ak{X + 1} = Z k (x) + Z k (x + 2) 

= o((Z k (x) + Z k (x + 2)y +£ ~ 1 ) = o(Z k (x + l)^" 1 ), 

which implies, for all 5 < min(l/2, 1 — 7) and e < 1 — 7 — 5, using Proposi- 
tion 3.1(c), 

Y+{x) = Y~ (x + 1) + o(Z n (x + iy s ) 
00 1 

( 8 ) = E { * fe= * +1} a fc -(x + 1) + o(Z n (x + iy s ) 

k=n Z k {x + L) 

= o(Z n (x + ly+c- 1 ) + o(Z n (x + l)- 5 ) = o(Z n (x + I)" 5 ). 

Note that, conversely, (8) always holds on T(x — l,x) for all 5 < a^>(x + 

2) A 1/2, since limsupa~(x + 2) = a^(x + 2) < 1 on T(x) by Corollary 3.1(h). 
Let us now assume that T(x — 1, x, x + 4, x + 5) holds and prove (iv). 

First observe that both a^ (x + 2) and a+ (x + 2) are strictly positive, using 
Remark 3.1. For all 5 < a+ (x + 2) A 1/2, Y+(x) = o(Z n (x + l)~ 5 ) by (8), and 
for all 5 < (x + 2) A 1/2 symmetrically (with respect to x + 2), y n ~(x + 4) = 
o(Z n (x + 3)- 5 ). 
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Accordingly, using Corollary 3.1(i) with x := x + 2, there exists 5 > such 
that 

In l^^l = Y n + (x) - Y-(x + 4) + o(Z n (x + l)~ s ) + o(Z n (x + 3)' 5 ) 

(9) 

= o{Z n {x + I)" 5 ) + o(Z n (x + 3)~ 5 ) = o(Z n (x + 2)~ s ), 

where the last equality uses the observation that o(Z n (x + and o(Z n (x + 
3)~ 5 ) are upper bounded by o(Z n (x + 2)~ s ), since /3^(x + 2) = ct^ (x + 2) > 
by Remark 3.1. 

Equation (9) implies 

a~(x + 2) - a" (x + 2) = o(Z n (x + 2)-< 5 ). 

Using (7), we deduce that 

lnZ n (x) = Y~(x + 2) = £ {^+2} a - (x + 2) = Q - {x + 2) lnZn(x + 2) . 

□ 



3.2. Comparison results. The following lemma considers the case of a 
sequence u n repelled by a on its right-hand side, where the repulsion depends 
on a function / of u n and on another sequence v n . It yields, when u n does 
not asymptotically remain in (—00,0], an estimate of u n as n goes off to 
infinity. 

Lemma 3.1. Let /:R — > R be a nondecreasing function, positive on 
(a, 00), and let (u n ) n ^ and (f n )neN be sequences that take values, respec- 
tively, in R and R + . Then 



u n h Y] f(uk)v k \ n I lim sup n w > a I C I liminf _° — >0 



Proof. Assume that u n ^ Un>a J2 k Z f( u k) v k and lim sup n ^ oc u n > a. 
Let e > be such that lim sup u n > a + 3e (e exists by the second assump- 
tion). The first assumption implies there exists ko G N such that, for all 
n > k > ko, if u m > a for all m £ [k, n] , 

(10) u n > u k + (1 + e)- 1 ^ f{uj)v)j - e. 

By definition, there exists k\ > ko such that u kl > a + 2e. We easily prove 
by induction, using (10) with k := ki that, for all n > fci, u n > a + e. It 
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follows from this claim that, for all re > k\ 



n-1 



u n -a>e + (l + e) l f(a + e)^Vj 

j=ki 



> min(e, (1 + e)" 1 /^ + e)) 1 + £ Vj) 



which enables us to conclude the proof. □ 

The comparison result stated in Lemma 3.2 gives us a tool which allows us 
to estimate the behavior of Z n (x + 6)/Z n (x + 2) [resp. Z n (x + 7)/Z n (x + 2)] 
on Oi(x) [resp. on ^(x)]. In particular, part (ii), which provides a sufficient 
condition for a site to be visited finitely often, implies on Qi(x) that if 
Z n (x + 6)/Z n (x + 2) does not converge to 1, then either x + 3 or x + 5 will 
be visited finitely often [and a similar result on Q2{x)], which allows us 
to conclude that it is a.s. impossible. The assumption that A(x) holds is 
technical and easy to check in the cases of application. 

Lemma 3.2. For all x G Z, define the stopping time 



T n (x) = inf{m >n/X, 



x} 



and the event 



A{x) = T(x)nl35>0/ 




Z n {x-2) 



o(mm(Z n (x-ir S ,Z n (xr S )) 



Z n {x-2) 



< oo 



eN Z n (x - 1) + Z n (x + 1) 




Then 




Proof. Assume that A(x) holds. Let us prove that 



n u 
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^ ^{x k ^=x-i,x k =x} Z k _ x (x - 2) + Zjfc_i(a) 
fc=i 



Z fc _i(x-1) Zk-i(x) 



= y> ^{Xk^x-l^X^x} Z k _ x (x - 2) 
Zk-i(x-l) Z k _i{x) 



k=l 



y> l{x fc _ 1= x,x fe =x-i} Z fe _i(a; - 2) 



Z fe _i(x) Z fc „i(x-1) 

^{x k ^=x} Z fc _i(g-2) 
b= ^ Z k -i(x) Zk-i(x-l) + Z k -i{x + l)' 



Indeed, the second equivalence follows from Theorem A.l(i), with 

M = y ^{x fc _ 1 =z-i,x fc =x> gfc-i(g - 2) + gfc-i(g) y ^{x fc _ 1=3; -i} 
" £i ^-l(^-l) ^i(x) ^^(x-l)- 

Indeed, (M n ) ng N* is a square integrable martingale and 

/ a f\ ^ ^{Xfc_i=^-i} Z fc _i(a - 2) + Z fc _i(a) 
< '"-jfeSfc-i(*-l) a ^-i(x) 

< 1 {x k . 1 =x-i} l {Xfc _ 1=x , 1} Z fe _i(a-2) 

-^Z fc _i(x-1) 2 ^Zfc_l(x-l)Zfc_l(x-l)Zfc_l(x) 

since -A(a;) holds. The third equivalence follows from the fact that T(x) = 
{y^(x) < oo} (by Proposition 3.1) holds. The fourth equivalence follows 
from an argument similar to the proof of Proposition 3.1(c), using the as- 
sumption 

Wx-2) _ 
Z n (x - 2) 

and observing that, by Lemma A.l(i), for all 5 > 0, if A{x) holds, 

y> ^{x k - 1 =x,x k =x-i} Z k -i(x - 
ti Z k ^(x) Z k _ x {x-\) 

Z fc _i(x) Z fc _i(x-1) + Z fc _i(a + 1) 

A l { x fc _ 1= x} / gfc_i(x-2) \ ^ 

^ Zfc.x^H-* U fe -i(x - 1) + Z fe _!(x + l); 1 < °°' 



fc 



where the second part of the equation follows from Z k _\{x) < Z k ~\{x — 1) + 
Z k _t(x + 1). 
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To prove the fifth equivalence, we observe that the process 
R = J2 1 {X k _ 1 =x,X k =x-l} Zk^x -2) 



fc=i 



Z k -i(x) Z k _i{x-l) 



_ Hxk.^x} Z fc _i(x- 2) 

^ Z k -x{x) Z k _i(x - 1) + Z k _i(x ■ 

is a martingale and that 



k=l 



oo 



Z k ^(x) 2 Z^x-lf 



< \- %Xfc_i=x} Z fc _!(x-2) Z k _ 1 (x-2) 

~ ' Z k _i(x) Z k ^i(x)Z k _i(x - 1) Z k -i{x - 1) + Z fc _i(x + r 



< oo 



if ^4(x) holds, and we conclude by Theorem A.l(i). Statement (ii) is a direct 
consequence of (i). □ 

3.3. Proof of Lemma 2.4: To(x) C T' (x). We suppose x := for sim- 
plicity (the problem is translation-invariant, since the initial point vq of the 
VRRW is arbitrary). The inclusion 

T (0) C jlimsupfsupc^ (2)/t£(2)) < lj 
follows directly from Corollary 3.1 (i) applied to site 2, that is, 

in W) = Yn+{o) - y -" (4) - ~ Yn ~ {A) - 

We first prove the inclusion 

(11) T (0) C {limsupZ n (4)/Z n (l) < e}. 

Let us assume that T (0) holds. It follows from Corollary 3.1(iv)-(v) that 
/3~(2) — > 0. Fix e > and ko G N, and assume that for all n > ko, (2) < e 
(e > is chosen in the proof). Let /i > e and assume, given p > ko, that 
^p(4) > /uZp(l). Let (i? n ) denote the property 

We prove that if p has been chosen large enough, then for all n > p, 
(H n+ i) holds when (H n ) holds. This implies that (H n ) holds for all n > p 
and, therefore, that limsupa~(3) < 1, and subsequently by Corollary 3.2(h) 
that T(l) holds, which leads to a contradiction by definition of Tq(0). 
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Let 

0p(2) 



Q, 



>(l + e)- 1 /3-(2). 



p l + /3p (2) " v ' ^ 

This proof is based on the following two inequalities, obtained on one hand 
by Corollary 3. 1 (i) (applied to x : = 3) and Proposition 3.1(c) [1^+(1) = 
Y~{2)\ and on the other hand by Corollary 3.2(i) applied to site 1: If p 
has been chosen large enough, then for all n>p, 

(13) In Z n (l) < In Z p (l) + Y~ (3) - Y~ (3) + e. 

Recall that 

y-(3)-y-(3)= J2 -vi^ a J( 3 y 
j= P+ i ^jy 6 ) 

We use the following heuristic: As long as (H n ) holds, a~(3) remains 
far enough from 1, which implies by (13) that Z n {\) grows slowly in com- 
parison with Z n (3), which implies that Y~(2) — Y~(2) remains small, and 
subsequently by (12) that a~(3) remains far enough from 1. 

If (H n ) holds, then for all j G [p, n], aj(3) < 1 — 5+ , which implies 

Yf (3) - Y- (3) < (1 - a+) In + e, 



which implies by (13) 



Z p (l) ~ \Z p (3) 
and, therefore, 

Z,(l) 



«7(2) 



<c 2e W 1 Z p {l) 1 



ZpQ) 1 -*} {Zj(l) + ^(3)) fi ? " Z^f-Zp Z^fv 
where we use Zj{2) < Zj(l) + Zj(3) in the second inequality. This implies 

y-(2)-y-(2)<e 2 - Zp{1) + ± 1{x > =2 \ 

<e 3e Z p (l) 1 1 



Z p {3) l ~ a i Zp (2) a p 
Op Z p {2) a p 
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where the third inequality follows from Z p (2) < Z p {l) + Z p (3) < e e Z p (3) for 
large enough p [recall that a~(2) — ► 0]. Therefore, using (12), 

if e < Cst(/i), which completes the proof of (11). 

The fact that limZ n (3)/Z n (2) = 1 a.s. on To(0) follows from (11) and 
a" (2) = 0, using Z n (2) < Z n (l) + Z n (3), and Z n (3) < Z n (2) + Z n (4). 

Corollary 3.2(h) and (hi) implies on one hand 

(14) T (0) C T(0) n {lima-(3) = 1} C {lim = 1 
and on the other hand 

(15) T (0) C {liminf a+(2) = 1} C {liminf = 1 

which gives the third part of the inclusion. 

Let us now prove that the lim sup of Z n (5)/Z n (3) is less than or equal to 
1. Assume To(0) holds. Let 

, Z n (5) 
u„ = m -— . 

Z n (3) 

By Corollary 3.1 (i) , 

u n = lng||=y-(6)-F+(2). 

For all a > 0, using Proposition 3.1(c) and the result given by (11), 

n n n -t\ 

Y ~((i\ - V-(R\ = V 1 {X fc „ 1 =5,X fc =6} \ - 1 {X fc _ 1 =5,X fc =6} 

„W- „ W ^ ^_ i(5) Zfc _ i(g) 

(16) 

= y+(5) = y+(4). 

The ^ inequality comes from Z n (6) > Z n (5) — Z n (A)^ Un>0 Z n (5) , since Z n (4)/ 
Z n (5) = e _n "Z n (4)/Z n (3) — > Un >oO, as a consequence of (11) and aQ(2) = 0. 
We prove similarly that y,+ (2)^! n > a y^~(4), which implies, together with 

(16) , 

«. == g(4)-y.-w=f: 

«n>a ^ Z n (4) Z n (3) + Z n (5) 

n-l 



^ l{x n =4} Z n (5) - Z n (3) 
^ Z n (4) Z n (3) + Z n (5) 
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Let us apply Lemma 3.1 with f(x) = 1 — e x and 

_ 1{X„=4} Z n (5) Hx n =A} 
Vn Z„(4) Z n (3) + Z n (5) u ">o 2Z n (4) ' 

Note that £fc=o w fc >r Un > lnZ n (4)/2. 

Using (15), we obtain that for all a > 0, limsupii n > a implies 

lim . nf jn£(6) = ln^(5) = ln(Z( 5) /Z ,(3)) 

lnZ n (4) lnZ„(3) T mZ„(4) 

and, accordingly, that T(4) holds. Remark 3.1 implies a^(2) > 0, which 
leads to a contradiction on Yo(0). The proof concerning Z n (0)/Z n (2) is 
similar. 

The statement Z^O) = ^oo(4) = oo follows from Z oo (0) y Y<^(1) as Yoo(l) : 
oo a.s. on T (0) C T(l) c [by Proposition 3.1(a)], which implies ^^(4) = oo 
by the other statements of this lemma. 

3.4. Proof of Lemma 2.9. We suppose x := for simplicity. Let us prove 
that, on f2i(0), the limsup of Z n (6)/Z n (2) is less than or equal to 1. The 
symmetrical statement (with respect to site 4) completes the proof. Our goal 
is to describe the evolution of the quantity Z n (6)/Z n (2); this description is 
obtained in (18). Assume in the sequel that f2i(0) C Y(0,4, 8) holds. 

First, we apply Lemma 3.2 (i). Let us use its notation for x := 4 and prove 
that A(A) holds. Using Remark 3.1 and Corollary 3.2 (iii) , we obtain that 
a+(2) and /3+(2) converge to a+ (2) > and that lnZ n (4) y a+ (2) In Z n {2). 
Hence, on one hand, 

limsup < lim/3+(2)^ 1 < oo, 

Z„(3) + Z n (5) 



Z n {2) 



(o+ (2))~ 1 z n (4)- 1 = oiz^r 1 ) = o(z n ( 3 )^i( 2 ); 



Z n (3)Z n (4) 

On the other hand, let us prove that there exists a.s. 5 > such that 

(17) i = o(Z „(2)-'). 

v ' Z n (2) v w 7 

Indeed, for all n G N*, let t n be the nth visit time to site 4. For all m G N 
and o > 0, let T m ' a := inf{n > m s.t. a^(2) < a}. There exists a.s. a > and 
m G N such that T m ' a = oo. 
Given a, e > and n G N, let 

T n+1 := {Z tn+1 (2) - Z tn (2) > Z tn (2)n^ 1 } U {T m ' a < t n+1 }. 

Let n G N be such that t n >m and assume n > Cst. Given t>t n such that 
rj < T m ' a , X t = 2 and Z 4 (2) < Z tn (2)(1 + ra £_1 ), the probability to reach site 
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4 in two steps starting from site 2 at time t is greater than an/(2Zt n (2)) 
and, therefore, 

, r t , ( an \S*n( 2 K -1 /2 / an £\ 

nn+i\Ft n ) < 1 - tt^t < exp -— . 



Accordingly, 



2^(2)7 " 4 



J] P(^) < oo a.s. 

neN* 



and the Borel-Cantelli lemma implies that occurs only finitely often. 
This gives (17), using InZ n (4) t a+ (2)lnZ n (2). 

Therefore, Lemma 3.2(i) implies, together with 0£(2) — ► a+ (2) > 0, 



lllZ ,, (2)slnZ ,, (3)s |! i gi_^|_. 

The situation being symmetrical with respect to site 4, we have a similar 
estimate for lnZ n (6). Hence, 

Mtt Z n (6) _ n ^ l {Xk =A}Z k (6)-Z k (2) 

{ ' Z r^)~h Z ^ Z k (3)+Z k (5Y 

Let us apply Lemma 3.1 with a = 0, u n = ln(Z n (6)/Z n (2)), f(x) = 1 — e~ x 
and 

Z n (4) Z n (3) + Z n (5) Un >o 2Z n {A) 

using that Z n (3) + Z n (5) = 0+(2)Z n (2) +/?-(6)Z n (6). We obtain, if limsupZ„(6)/Z„(2) > 1, 

liminf ^ = 1 + limmf ln(Z n .(6)/Z(2))lnZ n (4) 
InZ„(2) lnZ n (4) lnZ n (2) 

using the estimate lnZ n (4) y a^(2) lnZ n (2). 

Now, Lemma 3.2(h) completes the proof. Indeed, 

O l( 0)n{limsup||>l} 

Cfi 1 (0)nA(4)n{limsup|^||<l} 

C fii(0) n {Zoo(3) < oo} = a.s., 
where we use in the first inclusion that /3~(6) — ► a^,(6) > 0, by Remark 3.1. 
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3.5. Proof of Lemma 2.10. Suppose x := for simplicity. We use Lemma A. 2 
in the Appendix. Let us introduce a some notation first. Let, for all n G N*, 

T n := inf{k G N s.t. Z fc (3) = n or Z fe (6) = n} 

and let G := (<5 n )neN* := (•7 r T„)raeN*- We easily prove by induction that, for 
all n > 2, X Tn G {3,_6} and Z Tn (X T J =n = max(Z Tn (3), Z Tn (6)). For all 
n > 2, let us define Aj^ := 5 if A-r n = 3 and := 4 if Xrp n = 6. Let Tq = T\ = 
T2 := and, for all n > 2, 

r n+1 = {T n < 00} n {A Tn+2 = x T j. 

Assume that ^(0) H {a^(7) < 0^(2)} holds. Let us apply Lemma A. 2 
to prove that T n holds only finitely often a.s., which implies that Zoo (4) A 
Zoo(5) < 00 or Zoo(3) A Z OQ (6) < 00 (if 3n G N s.t. T n = 00) and, therefore, 
enables us to conclude. 

We settle upon the notation of Lemma A. 2. Let us choose the sequence 
( 7n ) that satisfies the upper bound of P(r n+ i|J r 4n ). Given 5 > and m G N, 
let 

A 5 , m :={Vn>m,|a-(2)-a-(2)| < Z„(3)~ 5 and |q+ (7) -a+(7)| < Z n (6)^}. 

By Remark 3.1 [/?+ (2) = a+ (2) > and /?- (6) = a~ (6) > 0] and Corol- 
lary 3.2(iv), there exists a.s. 5 > 0, m G N such that ^5 jm holds. We fix 5 > 0, 
m G N and suppose -A,5 im holds. We choose 7„ := (a^ (2) — ra~ 5 )lx T =3 + 

((4 n (7)-n- s )lx Tn =6. Note that 7n < a~ (2)lx Tn =3 + <*+ (7)lx Tn=6 by def- 
inition of A,5 )m . 

By Remark 3.1 and Corollary 3.2(iv), there exists a.s. h > such that, 
for all n G N, Z n (4) < /iZ„(3) a -( 2 ) and Z n (5) < hZ n {Q) a ^\ Then, if n > m 
and A Tn = 3, using Zr„(6) < r n and Zr„(3) = n, 

P(r re+1 |^ T J = o+ (3)a+ (4) </3+ (3)a+ (4) < Z Tn (4)Z r „(5)/Z T „(3) 2 

< /i 2 Z Tn (6) a -( 7 )z Tn (3) a -( 2 ^ 2 < fc 2 7£-( 2 Vn 1+a ~ (2) 

< /i 2 r^« /n 1+7T * , 

using a^(7) < aQ(2) in the fourth inequality and using, in the last inequal- 
ity, that 7 Tn < a^(2) and that x 1— > r^/n 1+x is nonincreasing on M + (since 
r n < n )- The estimate of P(r n+ i|^p n ) is very similar when Xx n = 6, which 
enables us to conclude. 

3.6. Proof of Lemma 2.11. We suppose x := for simplicity. Let us prove 
that, on 1)2(0)1 the limsup of Z n (7)/Z n (2) is less than or equal to 1. The 
symmetrical statement (with respect to the number 4.5) completes the proof. 
Assume subsequently that 1)2(0) holds. Let u n = ln(Z n (7)/Z n (2)). Similarly 
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as in the proof of Lemma 2.9, we try to describe the evolution of the quantity 
u n ; this description is obtained in (20). 

Let us begin with some elementary properties. By Remark 3.1, a^(2) = 
P± (2) G (0, 1) and a± (7) = /?± (7) G (0, 1). By Corollary 3.2 (iv), there exist 
a.s. 7^0 > such that Z n (4) x 7 ^Z n (2)«i( 2 ) and Z n (5) x 7 ^Z n (7) Q -( 7 ). 

Now, we can adapt the proof of Lemma 3.2(i) for x := 5 to show that 

(19) lnZ n (4) ■< 

1 ' 1 « n ">0j£i Z fc (5) Z fc (4) + Z fc (6) 

Indeed, there exists a.s. <5 > such that 

Z«(3) _ /%(2)^„(2) 



Z n (4)Z n (5) ^^^(2)^(2)^(7)^(7) 

= 0(Z n (7)- 5 -) - : 0((Z n (4)VZ n (5))- { ), 

M n >0 u n >0 

letting <5oo := a^(7) — a^(2) (>0 by Lemma 2.10) and, on the other hand, 
Z n (3) < 2n(3) ^ /3+(2) c _ M „ a+ (2) __ Un 



Z„(4) + Z n (6) " Z n (6) /3£(7) a«(7) 
^|l-l = (Z n (3)-). 

The last equality comes from the fact that when u n > 0, the probability to 
go from 3 to 5 is greater than a term on the order of Z n (3) e_1 for e > 0, using 
Lemma 2.10, and its proof is very similar to the proof of (17) in Section 3.4. 

Inequality (19) follows, which implies with the upper bound of Z n (3) / (Z n (4) + 
Z n (6)) that 

lnZ n (4)^a+(2)lnZ n (2) -< V <^ Z ^ 2 \ 

Hence 

(20) in^ y T ±{Xk=s} d Zk{2) ) 

since, by Corollary 3.2(iv), 

l n Zn (7) = lnZ " (5) = y h**=S} . 

Now, Lemma 3.1 with a = 0, u n defined below, 

mt _ l{x fc=5 } f(x) = l-e- x , 



a.oc{7)Z k {h) ' 
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implies that liminf u n /lnZ n (5) > and, therefore, limsuplnZ n (3)/lnZ n (6) < 
1, since 

liminf n [ } = liminf n [ } = 1 + liminf -i—r-r — n , \ > 1- 

lnZ n (3) hxZ n {2) lnZ n (5) lnZ„(2) 

Hence we can conclude, again by inequality (19) [as in Lemma 3.2(h) for 
x := 5], that ^oo(4) < oo, which is a.s. impossible [on ^(O)]. 

4. Nonconvergence toward unstable situations. 

4.1. Introduction. The aim of this section is to provide a result that 
ensures nonconvergence in the unstable situations that correspond to Lem- 
mas 2.5, 2.7 and 2.8, which are proved, respectively, in Sections 5.1, 5.2 and 5.3. 
This result makes use of the particular structure of reinforced random walks 
to overcome the fact that, in general, we can only obtain partial information 
on the behavior of the random walk. Indeed, as explained in the Introduc- 
tion, it is not, in general, possible to describe the behavior of the density 
of occupation of the random walk by the differential equation (3), which 
would enable us to interpret these unstable situations by unstable sets of 
the corresponding dynamical system and, therefore, allow us to use the clas- 
sical results of nonconvergence toward these sets. For this reason, we provide 
a result that requires only an equation of evolution of the considered un- 
stable quantity. This information is sufficient when the evolution involved 
is in some sense compatible with a partial order constructed on a certain 
class of random walks on Z. More precisely, we study the behavior of a 
(^n)ngN-adapted sequence (z n ) ne ^ that takes values in R and we try to 
prove that its behavior around is unstable, so that convergence to is a.s. 
impossible. 

The evolution of (z n ) n ^ is given by an equation of the form 



n j 



(21) z n+1 - z n = y n + e n+1 + r n 

where (y n )neN, (£n)neN* and (r n ) ngN are (^ n ) neN -adapted and 

E{e n+1 \G n ) = 0. 

Let us, for instance, consider the case discussed in Lemma 2.5: (zn)neN 
and (y n )ngN correspond to 

Zn = In — — — and 



Z tn (2) Z tn (2)^(3) 

where 

t„ = inf{mGN/Z+(2)>n}, 
R n = Z n (4) + Z n (2) - (Z n (l) + Z n (3)), 
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and 

n4+i\0n) -aj n (2)/n 2 , \r n \ = 0{l/n 2 ~ e ) for all e > 0. 

If z n and y n were of the same sign, we would be able to conclude (see, e.g., 
[8], [11] and [12], Chapter 3) that the unstable point z = is a.s. avoided, 
namely that 

(22) Fl lim z n =0 ) =0. 

V n^oo J 

This is not the case here and, in fact, y n does not depend only on z n . 
However, we can observe that the term Rt n increases only with visits from 
5 to 4 and decreases with visits from to 1. Indeed, it is easy to prove by 
induction that, for all n E N, 

Rn = Z-(5)-Z+(0) + (t {Xn=2 or x„>4}-l{x„<i or Xn =3})/2 + Cst(v ), 

(23) 
so that 

(24) R tn = Z+ (4) - Zf n (1) + Cst(«o), 

using that Zr n (5) = Z+(4) + Cst(^o) and Z+(0) = Z^(l) + Cst(v ). 

Heuristically, when z n tends to increase (resp. to decrease), the random 
walk tends to go more to the right (resp. to the left), which implies that y n 
also tends to increase. The precise tool behind these remarks is the definition 
of a partial order on the random walks. Lemma 4.1 claims the following 
result. 

Assume we deal with two random walks Ai and Ai' such that at each 
point j G Z, for the same number of visits to j, if M' has more visited j + 1 
than Ai and less visited j — 1, then Ai 1 has a greater probability than Ai to 
go right. Then we can couple Ai and Ai' so that for all j £ Z, for the same 
number of visits to j, Ai' has more visited j + 1 than Ai and less visited 
j — 1. In this case, we write that Ai' S> Ai. 

It is easy to prove that, given two random walks Ai and Ai' such that 
Ai' S> Ai, if we keep the same notation for Ai and add a superscript prime 
for Ai' , then, for all n G N, 

Having put down this partial order on random walks on Z, we observe 
in the considered cases that a significant part of the noise inherent in the 
behavior of z n is generated by the uncertainty on the visits from a certain 
vertex v to v — 1 (in the case of Lemma 2.5, v := 2). This leads us to define, 
concurrent to the VRRW called Ai, a random walk Ai' as follows. Starting 
from all points except from v, Ai' has the same conditional probabilities 
as Ai. From v the conditional probability to visit v — 1 is the probability 
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designed for M. minus a term on the order of the standard deviation of this 
probability on a large time interval. This new random walk is constructed 
in Definition 4.12. 

Lemma 4.1 implies that we can couple Ai and A4' so that A4' S> A4. This 
property has the consequence that, roughly, y' n is greater than y n ; more pre- 
cisely, Assumption (H3) of Proposition 4.1 is satisfied. Furthermore, the 
different moving probabilities from v imply here that z n in z' n undergoes 
a drift toward the right significant enough to cover the noise, which corre- 
sponds to Assumptions (HI) and (H2) is of the order of the standard 
deviation of z n starting at time The probabilities of a same group of 
paths for M and for M! being of the same order (stated in Lemma 4.2), 
these properties imply that the conditional probability not to converge to 
is always greater than a positive constant. This enables us to conclude that 
z n a.s. does not converge to 0. 

The section is divided as follows. In Section 4.2, we introduce some no- 
tation, and state and prove a coupling result for nearest-neighbor random 
walks on Z. In Section 4.3, we state the nonconvergence result Proposi- 
tion 4.1, which is applied in Sections 5.1-5.3. Proposition 4.1 is proved in 
Section 4.4. 

4.2. Notation and a coupling result. 

Definition 4.1. Given k G N U {oo} and v G Z fc+1 , for all n < k, we 
let v n be the (n + l)th coordinate of v. We say that v is a k path (or a 
path, when there is no ambiguity) on Z iff, for all < n < k — 1, there exists 
£„ G { — 1, 1} such that v n+ i — v n = e n . Let Vk be the set of k paths. Let 
V '■= T^oo- Given i G N*, j GZ and v6?jt, we let nj,-(v) be the time the 
sequence (v n )o< n <fc makes its ith visit to site j, with the convention that 
nij(v) = oo if j is visited less than i times. 

We make use of the notation introduced in Sections 1 and 2.2, that is, 
Z n (x)(v), Y n (x)(v), . . . , for all n < k, replacing the underlying (Aj)jgN in 
these definitions by (vj)j<=fq. 

Definition 4.2. For all k € N, let T k be the smallest u-field on V that 
contains the cylinders C v = {w G V/wq = vo, . . . ,Wfc = v^}, v G Vk- Let 
T := VfcgN^fc- Let us define the filtration T := (Tk)keN- 

Definition 4.3. On a probability space (O, P), we call a random walk 
a process (Xk)keN taking values in Z, starting from a fixed point Xq := vq G 
Z, satisfying the following conditions: for a.e. u> £ £1, (Xi(u>))i<zn G V and, 
for all k G N* and v£? fc such that v = v , P((Xj) <j< fe = v) > 0. 
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Definition 4.4. Let M := (Xk)k&N be a random walk on a probabil- 
ity space (£l,J-,F). Let Ij^: (p,,J-) — > (V,T) be the measurable function 
lu G i — ► (Xj(o;))j e N. Note that 2"^ defines naturally a probability on V 
by for all C G T, P^(C) := P(2^ f 1 (C)). For all n G N, let S* 1 :=lj}(T n ) = 
ct(Xq, . . . ,X n ). Let us define the filtration E := (£^ 4 ) n ^. Given a T- 
measurable random variable u, let us define the .F- measurable random vari- 
able u M :=uo Z M . 

Note that, if T is a T stopping time, then T M is a E^* stopping time. 
If (t n )neN is a nondecreasing sequence of T stopping times and if T [resp. 
(a n ) ng fsj] is a (% n )n£N stopping time (resp. adapted process), then T M [resp. 
(a^)neN] is a (SiMlneM stopping time (resp. adapted process). 

Definition 4.5. Let M := {Xk)kem be a random walk on a probability 
space (Q,J-,W), starting from vq G Z. For all G N U {oo}, vePj. such 
that v = v and n< fe, let <Lm(v,ti) := P7K(C(vo,...,v n ,v n +l))/ F A^(C(v ,...,v n )) 
be the conditional probability to go to the right at time n, knowing Xq = 
vq, . . . ,X n = v n . For all v G V, i G N*, j G Z such that ra»j(v) < oo, let 
P^j( v ) := <LM( v > n M'( v )) be the conditional probability to go to the right 
just after the ith visit to site j, knowing Xq = vo, . . . and X nij ^ = v n . ( v ). 

Subsequently, we fix the probability space (J7,.F,P), on which we take 
i.i.d. uniform [0,1] random variables (f^ij)ieK*jeZ- 

Definition 4.6. We construct (and settle) the random walks on (tt, P) 
by the following method. Given the initial point vq and the conditional prob- 
abilities of move 9.m(v) °f a random walk M, we let M := (X^keN on f2 
be as follows: Xq := vq and, for all n G N, given (Xo, . . . , X n ), 

X n+1 = ( Xn + if u z n {x n ){x ,...,x n )-i,x n < <LV((pfo, • • • ,X n ),n), 
n \X n — 1, otherwise. 

Definition 4.7. Let := (^fc)fceN be a random walk [on the probabil- 
ity space (Q,.F,P)]. Let, for all n G N, ^ := o-(w i)J -)( i) j) eN * xZ / ni Ai M ^))<n = 
a{{uij G /} n {?ijj(J M (a;)) < n}, i G N*, j G Z, / C [0, 1] interval). Note that 
^ cV^ 1 . Let us define the filtration := (jF^) n6N . 

Definition 4.8. Given v, v' G T 3 , let us define, for all i G N* and j G Z, 
the property Ei t j(v,v') as 

z n itj ( v ')(j + !)( v ') > z n itj (y){j + !)( v ) and 

Z ni> , ( V)(j-l)(vO<£ n . . (v) (j-l)(v) 

with the convention that Eij(v, v') holds whenever njj(v) = oo or njj(v') = 
oo. 
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Definition 4.9. Let M and M' be two random walks on (0,JF,P). Let 
M! S> Ai denote the following property: for a.e. to £Q, i^j(Z>((u;),Xvi/(u;)) 
holds for all i G N* and j G Z. 

Thns A4' S> means that, for the same number i of visits to j, Ai' has 
visited site j + 1 (right hand from j) more often than Ai and has visited 
j — 1 less often than Ai . 

Lemma 4.1. Let Ai and Ai' denote two random walks on Z [on the 
probability space (O, J 7 , P)], starting from the same point Xq = Xq = vq. Sup- 
pose that for all v, v' G V , for all i G N*, j G Z, p^- (v') > p^j (v) whenever 
Eij(v,v') holds and max^j^v), njj (v')) < oo. T/ien Ai' 3> .M. 

Proof. Consider an arbitrary element weSJ, Let v := I_m{oj) and v' := 
Zju'M, Pij --Pijiv), p' i4 :=pfj {v') and £ij := ^-(v, v'). We want to 
prove that, for all i G N*, j GZ, E%j holds. Observe the following facts: 

• One has vo = v. 

• For all pSN, there exists i G N* and j G Z such that p = njj(v): 

- if u^j < pij, then v p+ i = v p + 1; 

- if u^j > pij, then v p+i = v p - 1. 

The same remark holds, with v' and p\ j instead of v and pjj. 
Let us introduce the property 

P k = g N*, j G Z, s.t. n^v) < k and n^v') < k,E iyj holds}. 

Let us prove by induction on k that Pk holds for all fe G N. Note that Po 
follows from Xq = Xq = vq. Suppose Pk-i holds. We want to deduce Pk, 
which is different from Pk-i if there exists (i, j) G N* x Z such that [rii ,-(v) = 
k and njj(v') < fc] or [njj(v') = and nij(v) < k]. Select such a couple (i,j). 

If i = 1, then suppose, for instance, that j > vo = vq (the case j < vq is 
analogous, and j = v is obvious). Then Z n . .^(j + l)(v') = Z n . .^(j + l)(v) = 1 
and we aim to prove that Z n . .^(j - l)(v') < Z nij . (v )(j - l)(v). Suppose 
the contrary Z n ..^,){j - l)(v') > Z nij ^(j - l)(v). Let a = Z n . j{y) {j - 
l)(v) — 1. Since Pfc-i holds, E a j-\ holds and, therefore, v' a ,j-\ ^ Pa,j-i- 
Now v naj ._ 1+ i = v„ aj ._ 1 + 1 since a = Z n . j(y )(j - l)(v) - 1; this implies 
vi ,m =v' . , + 1 and leads to a contradiction. 

If i > 1, take v at time nj_ij(v) and take v' at time , (v'). We make 
use of the notation Ai or Ai' — > I or r to indicate that v (resp. v') goes to 
the left or to the right at this time rij_ij(v) [resp. nj_ij(v')]. Since Ei-ij is 
satisfied, P^-ij > Pi-i,j an d it is impossible that — > r and A4' — > Z. Hence, 
there are three cases: 

• Ai — ► I and Ai' — > r, and the conclusion follows; 
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• A4 — > r and M! — > r, and the conclusion follows from a proof similar to 
the case i = 1 . 

• M — > I and Ai' — ► I, and the conclusion follows from an analogous argu- 
ment. 

□ 

Definition 4.10. Let M = {X n ) nm be the VRRW on Z [on (fi, :F,P) 
according to Definition 4.6] defined in the Introduction, that is, defined by 
Xq := v o an d the transition probabilities, for all v G V and n£N, 

<Lvi(v,n) :=o+(v„)(v) = 1 - a~(v n )(v). 

Definition 4.11. For all x G Z, A; G N and M > 1, let us define the 
T stopping time U x ^,m by, for all veP, 

£4,ifc,M := inf { n ^ fc s/t - ^n(»)(v) > MZ k (x){v) or a~(a:)(v) > Ma^(i)(v)}. 

Definition 4.12. Let x G Z and M G Let us define, for all T stop- 
ping times k and V, and t/Gi;, the modified VRRW M' kVg [on (fi,.F,P) 
according to Definition 4.6] by Xq := vq and the transition probabilities, for 
all v G V and n G N, 

:= 1- a n (v n )(v)(l- 7fc(v)l {Vn=;Eand „ e [k,(/ I ^ MA y)}n{ 7t (v)<i,« t -(i)(v)<i/4M})' 



where 7 fe (v) := g/V Z k (x)(v)a k (x)(v). 

Observe that, for all k G N and g G M+, A^ jV ; 9 > M by Lemma 4.1. 

4.3. Nonconvergence result. Let c, <i, M G and ieZ. Let (t n )neN 
be an increasing sequence of T stopping times. Let (y n )n<=N, (z n )n^N and 
(W(n)) n< =fq be (7^J ne N-adapted random processes taking values, respec- 
tively, in M, in M and in R+, and let T be a (7^J ne pj stopping time such 
that n <T implies t n < oo. Let .A/f be the random walk in Definition 4.10. By 
a slight abuse of notation, for all n G N, we let t n := t^, T '■ = T M , y n : = y^ 4 , 
%n ■ — and J~ n . — J~ n . 

Assumption (HI) . There exists n G N (deterministic) and (;F tn )-adapted 
processes (£ n )neN* and (r n ) ng N such that, for all n > no, 

(25) z n+1 - z n = y n + e n+ i + r n if n + 1 < T 
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and, if n < T, 

E(e n+1 \T tn ) = 0, E(f>f +1 ^J) <d 2 W(n) 2 , 

(26) 

oo 

\rj\ < dW{n) 



\j=n 



j=n 

Let us use again the notation of Definition 4.12 (i£Z and M G Ml are 

M' 

already fixed). For all k, n G N and g G R+, let i' nfcs := t n tfc ' t2fc ' 9 , T' := 
T^W,*, ^ :=y ^^, flj ^ := ^*.« 3fc .« and jr/ := j^*.**^ Note 
that T' t , 

k,k,g 

to time ifc. 



that T[i = .Ft,, since the random walks M. and M.\, *„, „ are the same up 



Assumption (H2). For all 5 > 0, there exists n (deterministic, but 
dependent on g) and (J 7 '/ )-adapted processes (e^) nS N* and (r' n ) n ^ such 

n,k,g 

that, for all k>n,Q and n > no, 

Z n+l,k,g ~ Z n,k,g — Un,k,g ~l J, ^ne[k,2k) + e n+l + r n if n + 1 < T 

(27) 

and, if n < T' , 

\j=n ' / 

(28) 

Y \r'j\ < dW(n). 
j=n 

Note that T' , and also depend on k and 5, but we omit it for 

simplicity. 

Assumption (H3) . For all g G M+, there exists n G N such that, for all 
n>k> no, 

(29) y' nAg - Vn > -d\yn\[\z'n,k,g ~ *n\ + W{k)\. 

Proposition 4.1. Let c, d, M G W + and let x G Z. Let (i„) n eN be an in- 
creasing sequence ofT stopping times. Let (y n )neN, (^n)neN an d (W(n)) n ^ 
be (Tt n )n£N- adapted random processes that take values, respectively, in M, in 
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M and in and let T be a (7t n ) ng N stopping time such that n <T implies 
t n < oo. Suppose Assumptions (H1)-(H3) hold. Then 



(30) 



lim z n = } n 



J2 

,n<T 



< oo > Hi {T = oo} 



0. 



Notation. In the remainder of the paper (except Lemma 4.2 and its 
proof), we let M! := M' tktak gi forgetting the dependence on k and g. For 
any T- measurable random variable u, we write u (resp. u') instead of u M 
(resp. u ). In particular, we use notation a~(x) [resp. a'~(x)] for a~(x) 
[resp. a-{x) M '}, Z+{x) [resp. Z'+(x)\ for ^(x)^ 1 [resp. Z+{x) M '} and so 
on. The notation t' nkg , y' n k and z' nkg is used in this current section to 
emphasize the link with variables k and g [especially in (27)], but is replaced 
subsequently by t' n , y' n and z' n . 



Remark 4.1. Assume that y n can be written, when n <T, as 



[where (R n ) n ^ and (S , n ) ng pj are T-adapted processes, taking values, respec- 
tively, in R and R+] and that, when n < T A T' , 

R't' n >Rt n - 

Then a sufficient condition for Assumption (H3) is that, when n G [uq,T A 
T>), 



<d[\z' n -z n \ + W(m)}. 



Indeed, 



./ _ R k > R tn _ Stn 



which implies 



y'n-Vn> Vn (jjT ~ • 



Remark 4.2. In the conclusion of Proposition 4.1 [equation (30)], \Vn\ < 
oo can be replaced by J2ut < 00 or by S l2/n|lj/ n ^„<o < °°- Indeed, as- 
sume (HI) holds and z n — ► 0. Let us prove that ^ 2/n < 00 implies X) 2/n < 00 
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(and thus \Vn\ < oo); the proof of the converse implication is very analo- 
gous. Summing (25) from n := m to p, if m > no, 

p-i p-i 

z p -z m =Y J (Vk -Vk)+J2 (^+1 + r k) 
k=m k=m 



and, therefore, 



X Vk <zm+Y.yt + SU P 

k=m P^ m 



k=m 



p-1 
fc=m 



+ E N < 



CC 



k=m 



using (26) and Doob's inequality [W(m) < oo]. 

Similarly, J2 \yn\iy n z„<o < oo implies J2 \yn\iy n z„>o < oo (and thus J2 \Vn\ < 
using 

|z n+ i| - \z n \ > \y n \t ynZn >o - \yn\t ynZn <Q + sign(z n )(e n+ i +r n ), 
where, for all x G R, sign(x) denotes the sign of x. 

4.4. Proof of Proposition 4.1. The following lemma is useful in the proof 
of Proposition 4.1. 

Lemma 4.2. Let i£Z and M G R+. For all T stopping times k and 
V, and g G R+, Ze£ and M' k Vg be the two random walks on (p,,J-,¥) 
introduced in Definitions 4.6, 4.10 and 4.12. Then, for all r\ > and C G T, 

P^, ^(C|T fe ) < Cst( 5 ,M,? ? )P A1 (C|T fc ) + t/. 

PROOF. For simplicity, let M' := M' kVg = (X' n ) ne ^ and, for any T- 
measurable r.v. u, u := u M and vl := u M ' . Given n G N and v G "P, let 
I v (n) :=P^^(C (v0) ... iVn) )/P^(C (v0) ... )Vn) ).If 7fe (v) > lor o£(o0(v) > 1/4M, 
then I v (n) = 1. Otherwise, 



/ | 7 fe (v)l {vj _ 1=g|Vj= . E+1} a J -_ 1 (a)(v) 
V a+.^Xv) 



Let us upper bound In I v (n), using ln(l + x) < x for all x > — 1. We obtain 

ln/ v (n) < ^(v), 
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where (R n )n>k is the (7^) n >fc-adapted process defined by R k = and, for 
n > k + 1, 



nAVAU x ,k,M 
-Rn(v)=7fc(v) Hvj-l^} 
j=k+l 



L{v i= x-1} + 



l{v J=a; +l}«j-l( X )( V ) 



Our goal is to overestimate sup n i? n (v) [> sup n ln/ v (n)] on a T- measurable 
subset of V of large probability for A4'. To this end, we now analyze the 
behavior of the (^) ne N-measurable process R' n := R^* , depending on the 
random walk M' (recall that J-' n = )■ 

Let {R' n ) n >k be the compensator of (R n )n>k, that is, the (.T^n^fc-predictable 
process such that the process R' n := R' n — R' n is a martingale. For all n > k, 

= lk^{X' n =x}Hn<VAU' M } 



i , \/, \ a' + (x) + 7fca' (x) , 



Un (x) 



ll^{X' n =x}^{n<V>f\U' x k M } a 'n ( x ) 



a'n{x) 



Therefore, for all n> k, using cl- (x) < Ma k (x) < 1/4 and Z'-(x) < MZ k {z 
for all j < U' k M , 



(31) R' n < 2 7 2 (M - l)Z k (x)Ma k (x) = 2g 2 M(M - 1) 

Now, for all n>k, 



nK+i\K] < mK+i - KrlK] < lit 



2a' (x) 



< 1 



{X^=x,n 



<K., M y 2Ma k^h 



k ■ 



where V[- !.?>,,] is the variance conditional on T n . 

Successively using the Bienaym-Tchebycheff and Doob inequalities, for 
all A £ M*_ , 



( sup R' n >A T'fA < E ( sup.R 



\ n>k 



y2 



\ n>k 



f k )/A 2 <4E[R' 2 , AU , I.F fc ]/A 2 

x,k, M 



< %Ma~{x)%{M - l)Z k {x)/A 2 = 8M(M - l)g 2 /A 2 . 
Hence, by letting T be the T-measurable event 

T := (su Pj R n (v) > V8M(M - l)g 2 /i] + 2g 2 M(M - 1)1, 
we deduce, using R' n = R' n + R' n and (31), that 

F M/ (r\r k )< v . 
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On the other hand, for any path vGPnP, for all n G N, 

f>M>(C {vo ,..., v JT k ) < Cst(g,M, v )F M (C {vo _ v JT k ), 
which enables us to conclude. □ 



Let us now prove Proposition 4.1. Given e > 0, which is chosen subse- 
quently, let us define the stopping time Z m = inf{n > rn/YA=m\yi\ > e l- 
Let, for all m G N, 

T m := {limz n / 0} U {T A Z m < oo}, C m :=Tj}{T m ). 

It suffices here to prove that there exists g = Cst (c,d,M) such that if k > 
m V no, then P[C m |^ fc ] > Cst(c, d, M). Indeed, by a standard martingale 
convergence theorem, P[C m |J^ fe ] =E[l Cm |^ fc ] ^fc^oo lc m since C m G ^" too = 
<KU Therefore, l Cm > Cst(c, d, M) > a.s. and P(C m ) = 1 for all m G N. 
We conclude that P({limz n , / 0}U{£ |y n | = oo}U{T < oo}) = F(f] meN C m ) = 
1. 

Let 5 G be fixed later. Let us introduce the random walk M' tk t2k g 
(see Definition 4.12) and use the notation introduced in Section 4.3. Let us 
consider, for all k G N, 



A 



sup 

n>k 



i=k 



<4dW{k), sup 

n>k 



i=k 



+ 1 



<4dW(k) 



!■ 



Let us apply the Bienaym-Tchebycheff and Doob inequalities, and use As- 
sumptions (HI) and (H2): For all k>n,Q, 



c (A c |^ fc )< 



E(su Pn > fc (£7=^+i) 2 l^ fc ) , E(su Pn > fc (£? =fc ^ + i) 2 |^ 



+ 



t k . 



< 



Wd 2 W(k) 2 16d 2 W{k) 2 

1 

16 ~2" 

We want to prove that on A, T AT' A Z m < oo or z n -f+ 0. From now on, we 
suppose that A holds and that T AT' A Z m = oo. 

Observe that Assumptions (H1)-(H3) imply, for all i > k and n>i, 

(32) z' n - z n > z[ -Zi-de sup |^ -Zj\- d(W + e)W(k) 

je[i,n-l] 

and that for all n>2k (using z' k = z k , the coupled random walks A4 and 
A4' being identical up to time if.), 



(33) z 

Suppose n>2k and let 
u(n) :=sup|i G [k,n] s.t. \z\ 



z n >[cg -d(W + e)]W(k) -de sup \zj 

j€[k,n] 



■ SUp I Zj 

je[k,n] 



z u(n) z u(n)- 
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On one hand, using (33), 

\r n \ >r n > [eg - d(W + e)]W{k) - de\r n \. 

We take g := 24d/c and suppose e < Cst(ef); hence \r n \ > 12 dW(k). On the 
other hand, using (32) with i := k and n := u(n), 

r n >-de\T n \-d(W + e)W(k). 

Therefore r n < implies |r n |(l — de) < d(10 + e)W(k) and hence \r n \ < 
12 dW(k) [if we suppose e < Cst(d)], which leads to a contradiction. There- 
fore T n > 12 dW(k). For all n > 2k, (32) with i := u(n) implies 

z' n -z n > r n (l - de) - d(10 + e)W{k) > dW{k) > 

if we assume e < Cst(d). Therefore, 

F M {T m \T tk )+F M ,{T m \T tk ) 

= (F(l^(r m )\F tk )+F(l^(T m )\F tk ))ol^ 

> F( lim z n / or lim z' / or T A T' A W < ooljF, ) o XT. 1 

>P(A|^JoJ- 1 >l/2. 

In the equality, we use that JF tfc = T' t , and, for all C € and n € N, (C |7t n ) ■ 

F{Xj}{C)\T tn ) o J^ 1 [for all v G P (X^(C)| is constant on ^(v)]; 
similarly P.M/(C|T tn ) = F(Ij$,(C)\Tv n ) ol^ 1 ,. We also use that for all v£p, 
X_^ 1 1 (v) and Z^ 1 , (v) have the same projections on the t}~ first coordinates 
(the coupled random walks M and A4' are the same up to time £&). 
Now, Lemma 4.2 implies that for all t] > 0, 

p^(r m |r tfc ) < Cst( 5 ,M,7 ? )p M (r m |r tfe ) +7? 

and, therefore, 

F(C m \F tk )=F M (T m \T tk ) ol M > = Cst(c,d,M) 

if we take r\ = 1/4 (recall that we have chosen g = 24d/c). 
5. Proofs of Lemmas 2.5, 2.7 and 2.8. 



5.1. Proof of Lemma 2.5. 
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5.1.1. Notation. It suffices to prove that P(To(0) n T' (0)) = 0, because 
the problem is translation- invariant. We apply Proposition 4.1 to show it 
(as explained in Section 4.1) and use its notation. Let us first introduce our 
choice of the variables that appear in this lemma. 

Let us define a sequence (t n ) n eN by 

t n : = inf{m G N s.t. Z+(2) > n}. 

Let, for all n G N, 

R n = Z n {2) + Z n (4) - (Z n (l) + Z n (3)). 
Let (y n )n£N and (zn)neN be the (7^ n )-adapted processes defined by 

R >- 3 „:=ln Z -< 3 » 



Z i „(2)Z«„(3)' Z,„(2) 

if i n < oo, and y n = z n := else. 

Given e > 0, for all mGN, let T™ ,£ and T™' 6 be the F(t n ) n6N stopping 
times defined by 

T™' e :=mf{n>ms.t. Z tn (A) > e(l + e)Z tn (l) or o£(2)>(l + e) inf a£(2) 

m<j<n J 

or Z t „ (1) A Z t „ (4) £ [(Z^ (2) V Z t „ (S)) 1 ^, eZ tn (2) A Z*„ (3)]}, 
T 2 m ' e := inf{n > m s.t. t„ = oo or 3y G [1,4] s.t. Z tn (y) - Z tn _,(y) > Z^yf} 
and T m ' £ := T™ ,£ A T 2 m,£ . 

Lemma 5.1. Foralle>0, 



T o (0) n T' (0) C {limz n = 0} n {^y- < oo} n ( |J {T™> £ = oo} ) 
Proof. Observe that a.s. on T (0) n T' (0), 

ZtM z tn (i) 1 



l{X n =2,X„+i=l} 



£N Z tn (0) + Z tn (2) Z tn (1) + Z tn (3) Z t „ (1) 
H V q~(l) ]I{Xn=1} ps V 1 { x "= 1 - x "+i=°} 

Y7T) <0 °' 
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where we use (23) in the first relationship, the definition of To(0) n Tg(0) 
in the second and seventh relationships, Lemma A.l(i) in the third and 
fifth relationships, Proposition 3.1(c) in the sixth relationship and, finally, 
T(0) = {Y+(0) < 00} by Lemma 2.1. 

The fact that there exists a.s. on To(0)nT()(0), m S N such that T™' £ = 00 
can be proved as follows: For instance, for Z tn (l) — Z tn l (l), the probability 
to visit 3 starting from 1 in two steps is asymptotically greater than 1/4, 
so we can use a method very similar to the proof of (17) to estimate the 
number of visits to 1 between times t n —\ and t n . The other points follow 
from the definitions. □ 

Lemma 5.1 implies, together with Remark 4.2, that it suffices to apply 
Proposition 4.1, m and e being fixed, with (t n ) ne f$, (y n )n<=N and (£ n )neN as 
defined below, to conclude that P(Tq(0) n Tg(0)) = 0. Let us choose here 
the other constants that appear in the application of this lemma (the choice 
is justified afterward): c := 1/64, d := 8y/l + e, M := 4, x := 2, W(n) := 
Va7(2)/n and T := T m < £ . We choose e in the following text. We check in 
Sections 5.1.2-5.1.4 that Assumptions (HT)-(H3) hold. 

5.1.2. Assumption (HI) of Proposition 4.1 holds. Let n £ N be such that 
n < T. We need to define a continuation of z n +i on n + 1 = T, so that 
conditions (25) and (26) hold. Let us define 

Z tn+1 (2) := inf {i > Z tn (2) + 1 s.t. w< _ lj2 < max«_ 1 2 (2) , a+ (2) - Z tn (l)^ 1 )}, 

where rii i G N*, j £ Z, is the ith visit time to site j, as in Definition 4.1. 
We apply the convention that a+ (2) = whenever nj_i 5 2 = 00. 

Note that Z tn+1 (2) is Ft n+1 -measurable and that Z tn+1 (2) = Z tn+1 (2) when 
n + 1 < T. Indeed, Z tn+1 (l) < Z tn (l) + Z tn (l) £ implies, for all k G [t n ,t n+1 ], 
a- k {2) < a+ (2) + Z tn {lf- 1 [hence a+(2) > a+ (2) - ^(l) 6 " 1 ]. 

Let V n+ \ := Z tn+1 (2) — Z tn (2). Then V n+ \ is lower and upper bounded by 
two geometric random variables with success probabilities af n (2) — Zt n (l) 5 " 1 
and af n (2) , and, therefore, assuming e < Cst and n > Cst [note that Zt n (2) > 
n], 

E(K + i|^J e k+ (2)- 1 , (a£(2) - ^(ir 1 )" 1 ] 

34 

C[a+(2)- 1 ,a+(2)- 1 + 2^ n (ir 1 ] 

and 

(35) E((K+i " l) 2 |^iJ < 3(a t - (2) + ^(l)^ 1 ) < 6^(2). 

Indeed, if ^ is a geometric r.v. with success probability j> and if 1 — p < Cst, 
E(C) = 1/p, E((C - l) 2 ) = (1 -p)(2 - p)/p 2 < 3(1 - p). 
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Let us define Z tn+1 (3) similarly so that if W n+ i := Z tn+1 (3) — Z tn (3), 
E(W n+1 \F tn ) e ^(S)" 1 ,^- (3)" 1 + 2Z tn (4) £ - 1 ] 
and such that the estimate analogous to (35) holds for W n+ \. Let 



z n+l : = 



In 



^„ +1 (2) : 



r n := E(z n+ i - z n \F tn ) ~ Vn 



£n+i z n+ \ — z n — E(z n+ i — £ n K *„)• 
Note that if e < Cst and n > Cst(e), using notation □ in Section 2.1, 



E In 



^„ + i( 2 ) 



^(2) 



E(K+i|^ 



^n(2) 



E(K 2 + il^J 

2^(2) 2 



Zt n {2) 

<(2)^ 
^„(2) 



(36) 



+ □ 



+ □ 



2^(1) 



£-1 



+ □(-5 



1 



2n 2-3 £ 



using | ln(l + x) — x\ < x 2 /2 for x > in the first equation, ~E(y 2 +l \Ft n ) < 2, 

■^t n (2) > n and (34) in the second equation, and Zt n (Xf~ X < n~^ e ^ 2 < 
l/(4n 1_3e ) in the third equation. 

Using a similar estimate for K(lnZ tn+1 (3)/Z tn (3)\J : 't n ), we obtain 

(37) E(z n+ i - z n |^ t J = y n + □(l/n 2 " 3£ ). 

Therefore, r n = □ (l/n 2 ~ 3e ) is such that 



< 



J =71 



\j=ra 



; -2-3 £ / - (l-Se)^-!) 1 - 



3c 



<2i 



'« t "(2) 



n 



using ct tn (2) > 1/n , if e < Cst and n > Cst(e). 
Let us now estimate E(e 2 , x | Tt„)'- 



V In 



^i( 2 ) 



^(2) 



<E 



< E 



lnl 1 + 
ln( 1 + 



r, 



n+l 



Zt n {2). 

Vn+l ~ 1 

^„(2) + l 



In 1 + 



Zt n {2) 



2 ^ \ < E[(K +1 -1) 2 |^J < 6a^(2) 



71- 



using (35) (note that the second inequality is an equality). Using a similar 
estimate of conditional variance of log Zt n+1 (2) / Zt n {2) , we obtain, if e < Cst 
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and n> k> Cst(e), 

12(a t "(2)+a+(3)) 



E« +1 |^J< 



(38) 



n 



2 



24a f -(2)(l + e) 48(1 + e)a f - (2) 

— 9 — 9 



using a+ (3) < 2ea t " (2), since n < T™' £ . Indeed, Z tn (2) e [(l+e)- 1 Z tB (3), (1 + 
e)Z tn (3)] [Z tn (3) < Z tn (2) + Z tn (4) < (1 + e)Z tn (2) and the other inequality 
is similar]. 

We conclude from (37) and (38) that (26) holds and, therefore, that As- 
sumption (HI) is satisfied when e < Cst and n > Cst(e). 

5.1.3. Assumption (H2) of Proposition 4.1 holds. Note that j tk := g/V Z tk (2)a7. (2) < 
1 if k > Cst (5) and e < Cst. Let us prove that 2k <T implies t2k < U2,t k ,M 
so that in Definition 4.12 for the transition probabilities of M! := -M-' tk t2k g 
(in the statement of Proposition 4.1), t2k A t^i&.M = ^2fc- This implies that 
if 2k < T' , the probabilities of moving from site 2 to site 1 for M' are the 
VRRW probabilities multiplied by the factor 1 — j tk from time t\. to time t' 2k ■ 
First, o£(2) < (1 + e)a t ~(2) < 2a t ~(2) as long as n < T by definition of T, 
if e < 1. Second, if n <2k <T, then Z t „(2) < Z+(2) + Z tn (l) < Z+(2) + 
eZ in (2), so that Z tn (2) < (1 - e)' 1 Z t +(2) = (1 - e)"^ < 4fc if e < 1/2™. 

Let n £ N be such that n <T' . We define 

Z[, (2) :=inf{ i >Z;,(2) + ls.t. 

n+1 n 

1 - Wi-1,2 > (1 - 7t fc ln e [ fc ,2 fc ))min(<; (2),a£"(2) + Jl)*" 1 )}, 

t— 1,2 n 

with the convention that a 7 (2) = 1 whenever n' 1 9 = 00. 

n i-l,2_ ' 

Similarly as in Section 5.1.2, Z', (2) is T[, -measurable and Z', (2) = 

n+1 n+1 n+1 

Z'.i (2) when n + 1 < T' . We define Zl, (3) in the same way (but the factor 

1 — jt k does not appear, since the probabilities of moving are only changed 
starting from 2, according to Definition 4.12). 
Instead of (36), we obtain 



E hi- 



, ] = __ — +D 



Z' (2) " *»7 ZL (2) ' ^\2n 2 -^ 

r n 

and when n E [fc, 2k A T"), 

[l-(l- 7tfc )q;7(2)]- 1 ag(2)- 1 
Z'{2) Z'{2) 
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1 + 



< 



a'+(2)- 
Z't> (2) 



a'+(2) 



-i 



< 



7t fc a t -(2) < gW(k) 



2ZL (2)a't(2) 2 ~ 2,2k ~ Uk 

using in the first inequality that (1 + x)~ l < 1 — x/2 for x S [0, 1] and using 
in the second inequality that Z' t , (2) < Ak (see the first paragraph of this 

section, and similarly Z' t , (3) < Ak, which implies a' t 7 (2) > (2)/4 [recall 

that ou "(2) = <x7(2)l. The rest of the proof is analogous to the proof of 

Assumption (HI), so that we obtain (27) and (28). 

5.1.4. Assumption (H3) of Proposition 4.1 holds. Let us use Remark 4.1, 
with R n := R n and S n := Z n (2)Z n (3). First observe that R' t , > Rt n , since 
A4' S> A4. This comes from the fact that M! tends to go more to the right 
than Ai, so that Rt n , which increases only with visits from 5 to 4 and 
decreases with visits from to 1, is larger for A4' than for M. More precisely, 
M' > M implies on one hand that Z t ',+ (4) > Z^(4) and Z' t 7{l) < Z t ~(l), 
and on the other hand by (24) that R t < R' t , for all t, feN such that 
X t = X{„ Z'+{&) > Z+(4) and Z'f(l) <Z^(1). Second, if e < Cst, 



Z t „(2)Z tn (3) 



Z[, {2)Z< (3) 



1 



< 2 



< 2 



ln 



Zt„(2)Z tn (3) 



Z' (2)Z' (3) 



^ (3) Z t 
ln^44 + ln ' 



(2) 



2\zL 



ZtM z[, n (2), 

The first inequality follows from \x\ < 2| ln(l + x)| for |x| < 1: Indeed, Zt n (2), 
Z in (3), Z' t , n (2) and Z^(3) are close to n (e.g., Z tn (2) E [Z+(2),Z+(2) + 
eZ tn (2)] and Z tn (2) = n; see Section 5.1.3), so that Z^ (2)/Z tn (2) and Z[ n (3)/Z tn (3) 
are close to 1. The second inequality is a consequence of Z[, (3) > Z tn (3) and 
Z[, (2) < Z tn (2), which follows again from M' > M. 

5.2. Proof of Lemma 2.7. It suffices to prove that P(Oi(0)) = 0, because 
the problem is translation- invariant. We prove a preliminary result in Sec- 
tion 5.2.1 and then show the result in Section 5.2.2, using Proposition 4.1. 

5.2.1. A preliminary result. The following lemma implies that a.s. on 
fii(O), Z n (0) V Z n (4) V Z„(8)/Z n (2) A Z„(6) tends to 0. 



Lemma 5.2. One has 



ni(o) c n iim 

n. — >r* 



i=0,4,! 



Z n (i) 
Z n (2) 



44 P. TARRES 

Proof. Let us prove, for instance, that Z n (0)/Z n (2) — > on S7i (0) ; the 
proofs of the other statements are similar (using also Lemma 2.9). Observe 
that, by Proposition 3.1(c) and Remark 3.1, 

JMO) C T(0, 4) n {Zoo (2) = cx)} C (Y-(l) < cx)} n (2) = a" (2) > 0}. 

Assume that Oi(0) holds. It suffices to prove Z n (0)/Z n (l) — > 0. There exist 
a.s. a G (0, 1) and p G N such that, for all n>p, Z n (l) > aZ n {2). This implies, 
for all n>p, 

Y-m-Y- m-v 1Xfc=1 gfeW >y^=i ^n(o) 



n Z k (l) Z k (0) + Z k (2) ~ ^ Z k (l) Z n (0) + Z fc (2) 
■> 7 frV\ lx fc =i Z n (0) 

- [) L ^ + z «(°)) 2 " a ^(°) + + 1 ' □ 

5.2.2. Application of Proposition 4.1. We apply Proposition 4.1 and use 
its notation to prove P(Oi(0)) = 0. Let us first introduce our choice of vari- 
ables that appear in this lemma. Let us define a sequence (i n )neN : 

t n : = inf{?n G N s.t. Z m (4) > n}. 

For n>2,t n is the time of the (n — l)th visit to site 4. 
For all n G N, let 

R n = Z n (5) + Z n (7) - (Z n (l) + Z n (3)). 

Let (y n )neN and (z n ) nG N be the (7t n )-adapted processes defined by 

Rt z t (6) 

yn '-n(Z tn (3) + Z tn (5)y Zn '- lU tM 

if t n < oo and by y n = z n := otherwise. Given e, a > 0, for all m G N, let 
rpa,m,e a ^ rpm,e ^ e ^ e F( in ) ngN stopping times defined by 



T?> m > E := infjn > m s.t. Z u ^)/Z u (2) £ [1 - e, 1 + e] 



or sup Z tn (j) > £ Z* n (2) or a+ (2) A a£ (6) < a 
je{0,4,8} 

or inf [ln(Z fn (5)/Z t .(5))- 2a" 1 ln(Z t „ (4)/Z t .(4))] > el, 
je[m,n] J 

j,m,e ._ j n £| n > m g t n = OO 

or 3 y G [1, 7] s.t. Z tn (y) - Z^ (y) > Z tn _, (yK" 1 } 
and T a ' m ' £ := lf- m,e A T 2 m ' e . 
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Lemma 5.3. Foralle'>0, 



n 1 (o)c{iimz n = o}nlj2\yn\ty nZn <o<oo\nl \J {r a > m ' £ = oo} 

InSN J V a>0, mSN 




Proof. Let e > and suppose f2i(0) holds. The existence of m £ N, 
a > and e < e' A 2~ 2a 1-3 such that T^ ,m,£ = oo follows from Lemmas 
2.9 and 5.2, Remark 3.1 and Corollary 3.2(hi). The proof of the existence 
of m G N such that r™' £ = oo follows from an argument very similar to the 
proof of (17) [which gives the estimate of Z tn (y) — Z tn _ 1 (y) for y = 2]. 

To estimate the sum of \y n \^-y n z„<o, observe that y n z n < implies R tn (Z tn (6) ■ 
Z tn {2)) <0; hence, 

|#d < \Rt n - (z tn (6) - z tn (2))\ < z t ,M + z t ,M) + ZtM- 

Therefore, it suffices to prove that 

1 {^n=4} Z n (0) ^ 1{X„=4} Z n (8) 

7 — < no \ — <^ pv~) 

Z„(4) Z B (3) + Z B (5) < ' ^ Z„(4) Z n (3) + Z„(5) < ' 

since the sum involving Zt n {&) is obviously finite on f2i(0) C {1^0(4) < 00}. 
Whereas S7i (0) is symmetric with respect to 4, let us prove the first inequal- 
ity: 

1 {x n =4} Z n (0) 
^ Z n (4) Z n (3) + Z n (5) 

^ \ " 1 {X„=4,X n+2 =2} gn(0) \ - l{X„=2,X u+2 =4} Z n (0) 
^„Vm ^(4) Z n (3)~^ Z B (4) Z n (3) 

a \- 1 {X n =2} Z n (0) _ \ - 1{X„=0} Z n (0) 



Z n (2) Z n (l) + Z n (3) ^ Z n (0) Z n (-1) + Z„(l) 



E 



1 {X„=0} 



neN z n (-i) + z n (i) 

In the second equivalence, we use an argument similar to the proof of Propo- 
sition 3.1(c). In the last equivalence, we use the same principle as in the 
previous arguments. □ 

Lemma 5.3 implies, together with Remark 4.2, that it suffices to apply 
Proposition 4.1, a, m and e < e' < Cst being fixed, with (i n )neN> (yn)neN and 
(■z n )neN as defined below, to conclude that P(f2i(0)) = 0. Let us choose here 
the other constants that appear in the application of this lemma: c := 1/8, 
d:=4a -1 , M:=2 2a ~ 1+1 , x := 5, W(n) := l/y/ri and T := T a ' m > £ . 
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We leave to the reader the proof that Assumption (HI) holds, since it is 
very similar to the proof of the same fact in Section 5.1.2. Concerning the 
proof of Assumption (H2), let us show that 2k < T implies t2k < U^^ k ,M- It 
follows directly from 2k = Z t2k (4) = Z tfe (4) that a f ~ (5) < 2a f ~ (5) for all n < 
2k. On the other hand, if n < 2k < T, then ln(Z tn (5) /Z t2k (5)) < 2a" 1 In 2 + 1 
if e < 1, which implies Z tn (5) < 2 2a 1+1 Z tfc (5). The rest of the proof that 
Assumption (H2) is fulfilled is left to the reader. 

Let us check Assumption (H3), using Remark 4.1. First, A4' S> M. implies 
R't' > Rt n • Second, we need an estimate of 



Zt„(3) + Z t „(3) 



< 



Z tn (3) + Z tn (5)-(ZU3) + Z'(5)) 



Z' (3) + Z' (5) 



^(3) + ^,(5) 
Note that 

Z tn (3) + Z tn (5) = n + Z t ; (3) + Z+ (5) + Cstfo), 
Z[, (3) + Z[, (5) = n + Z' t 7 (3) + Z[t (5) + Cstfo) 

and 

Z'+(5) - Z+(5) < Z[, n (6) - Z tn (6), Z t ~(3) - Z^(3) < Z tn (2) - Z t ', (2). 
Indeed, the first inequality follows, for instance, from 
Z tn (6) = Z+(5) + Z+(6) + Cst(«o), Z[, n (6) = z£(5) + Z£(6) + Cst(«a), 
which implies 

Z;, (6) - Z t j6) = Z;+(5) - Z+(5) + Z t '+(6) - Z+(6) > 4+(5) - Z+(5), 

where the last inequality follows from ZL (y) > Z tn (y) and Z'J~(y) > Zf (y) 
for y > 4, and ZL (y) < Z tn (y) and Z t 7(y) < Z.~ (y) for y < 4, as a conse- 
quence of M' 3> M. 

To summarize, as long as n <T AT' , if e < Cst, 



Z tn (3) + Z tn (5) 



Z' (3) + Z' ; (5) 



^ Z;,(6)-Z tn (6) Z f j2)-Z;,(2) 

^z t ',(3) + z;,(5) + z;,(3) + z;,( 5 ) 

^(2) Z tn (6) 



< 3a 



Z' (2) Z> (6) 



<4a- 1 |4 



5.3. Proof of Lemma 2.8. It suffices to prove that P(O2(0)) = 0, because 
the problem is translation- invariant. We prove a preliminary result in Sec- 
tion 5.3.1 and then prove the result in Section 5.3.2, using Proposition 4.1. 
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5.3.1. A preliminary result. Let, for all n G N, 

1 Z n (4)Z n {5) 



A 



n ■- 



Z+(4) Z n {2) 
Lemma 5.4. One has 



0.2(0) C (BAoo := lim A r 



PROOF. Suppose fi 2 (0) holds. Then Z n (7)/Z n (2) -» 1 by Lemma 2.11 
and /2^(2) — > a J, (2) > by Remark 3.1. Using Corollary 3.2(iv), we obtain 
that Z n {b)/Z n {2) a ™W and Z n (4)/Z n (2) a ^ converge to a positive value. 
Note that these statements imply Z n (5)/Z n (3) = /?+(2)" 1 Z n (5)/Z n (2) -> 0. 

Therefore, there exist a.s. finite random variables 7^, i £ {1,2,3,4,5}, 
such that 

n 

Z r j+l(4) = E 1 {X k =4,X k+1 =5} 

n n 

x 7^o E l { x fe =4}^(2) Q - (7) - 1 ^ 7^, E l {J r fc =4}^(4) ai(a) " 1(oi(7) - 1) 

fc=0 fc=0 

x 7 ^ n (4) a »( 2 )" 1 (^( 7 )- 1 >Z n (4) 

^-,4. f2) q-f7^n(4)„ 5 Z n (4)^(5) 

where we use the conditional Borel-Cantelli lemma, Lemma A.l(i), in the 
first equivalence and use a+ (2) _1 (a^ (7) — 1) > — 1 [since a^(2) < a^(7) 
by Lemma 2.10] in the fifth equivalence. □ 

5.3.2. Application of Proposition 4.1. We apply Proposition 4.1 and use 
its notation to prove P(O j2 (0)) = 0. Let us first introduce our choice of vari- 
ables that appear in this lemma. Let us define a sequence (i n )neN by 

i n = inf{meN/Z+(4)=n}. 

For all n £ N, let 

Rn := Z n (6) + Z„(8) - (Z„(l) + Z„(3)). 
Let (y n ) n GN and (z n )ngN be the (7^ n )-adapted processes defined by 

""■"^(4)^(5)' Zn - ln Z tn (2) 
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if t n < oo and by y n = z n := otherwise. 

Given e, a, b > 0, for all m G N, let T?' b ' m ' e and T™' £ be the F (tn)nSN stop- 
ping times defined by 

T a,b,m,e . = > ^ ^ ^ (?)/ ^ (2) ^ ^ _ £ j + £] 

or A tn /6 [1 - e, 1 + e] or o+ (2) A o£ (7) < a 
or sup a£(5)/ar£(5)>2 

m<k<n 

or sup (Z tn (5)/n a - 1 )/(Z t Jk^ 1 )>2 

m<k<n 

or sup Z tn (V) >eZ tn (2) 

v£{0,4,5,9} 

or sup v^|(y+(6)-y,;(6))-(y+(6)-y,7(6))|>ij, 

m<k<n ) 
jm,e ._ j n £| n > m g ^_ t n = oo 

or 3 y G [1, 8] s.t. Z tn (y) - (y) > Z^ (yK" 1 } 

and T a,6,m, e . = T a,b,m,e A ym.e 

Lemma 5.5. For a// e' > 0, 

n 2 (o)c{iim^ = o}njx;ii/«IW<o<oo}n( |J {r^ m - £ = oo} 

InGN J V a,b>0, mGN / 



'Aa2~ 2a ~ 1 - 3 



Proof. Let e' > and suppose ^(0) holds. Then t n < oo for all n G N 
and z n — > 0. Let us prove the existence of m G N, a, 6>0 and e < e' A 
a2~ 2a 1-3 such that T^' b ' m ' e = oo. Lemma 2.11, Remark 3.1 and Lemma 5.4 
imply that Z n (7)/Z n (2) 1, a+(2) -> a+(2) G (0,1), a" (7) -> a" (7) G 
(0, 1) and A n — ► Aoo > 0. Moreover, Corollary 3.2(iv) implies 

lnZ n (4) = a+(2)lnZ n (2), lnZ n (5) = a" (7) lnZ n (7), 

and similar estimates for lnZ n (0) and lnZ n (9), so that sup 1)G | ,4,5,91 Z tn (v)/ 
Z tn (2) — ► and sup n>fe a~(5)/a^"(5) — ► 1 [there exists a.s. 700 > s.t. a~(5) x 

7ooZ n (2)^( 7 )- 1 ]. 

There exist random variables 7^ , 7^ > such that 

^(^7i« fc(7)+ai(2HrI 
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[using A tn = Z tn (4)Z tn (5)/(nZ tn (2)) - A*,] and 

Z t (5)X7 2 n ai(2)(«i(7)+a+(2)-l)- 1 _ 

Hence, there exists a.s. a' > such that sup n>k (Z tn (5)/n a 1 )/(Z tk (5)/fc a 1 ) — 
1 for all aG (0,a'). 

Next, observe that a+ (2)(a^ G (7) + a+ (2) — l)" 1 > 1 implies that there 
exists v < 1/2 such that Zf n (5) u / y/n — > oo. Accordingly, using Proposi- 
tion 3.1(a), 



y+(6) = yr (6) + o(z 4n (5)-") = yt (6) + G (n 



-l/2> 



The proof of the existence of m G N such that T 2 ' = oo relies on the 
observation that if t > t n is such that, for all y G [1,9], Z t (y) — Z tn (y) < 
Z tn (y)n e_1 , then the probability to visit 4 at time t + \X t — 4| if X t G [5, 9] 
(resp. to visit 5 at time t + \Xt — 5| if Xt G [1,4]) is greater than a constant 
multiplied by n/Z tn (X t ) (using A tn — > Aqq). The result follows from an 
argument very similar to the proof of (17) in Section 3.4. 

To estimate the sum of \yn\^-y n z n <o-i observe that y n z n < implies R tn (Z tn (7) — 
Z tn (2))<0; hence, 

\RtJ < \Rt n - (Z tn (7) - Z tn {2))\ < Z tn (0) + Z tn (4) + Z tn (5) + Z tn (9), 

which enables us to conclude the proof using 

\ - SUPt,£{0,4,5,9} Z t n {v) \ - SUPi,e{0,4,5,9} Z tn (v) 1 

^ ZtMZtM Z tn (2) n <0 °- □ 

Lemma 5.5 implies, together with Remark 4.2, that it suffices to apply 
Proposition 4.1, a, b, m and e < e' < Cst being fixed, with (t n ) n eN, (Vn)neN 
and (z n )neN as defined below, to conclude that P(f22(0)) = 0. Let us choose 
here the other constants that appear in the application of this lemma: c := 
Va/(46 3 / 2 ), d := 20 V 46" 1 , M : = 2 a ~ 1+1 , x := 5, W(n) := 1/^/n and T : = 

ipa,b,m,e 

We leave to the reader the proof that Assumption (HI) holds, since it is 
very similar to the proof of the same fact in Section 5.1.2. 

Concerning the proof of Assumption (H2), let us show that 2k < T implies 

t 2 k < U 5>tk>M . For all n < 2k < T, a t " (5) < 2a t " (5) and Z tn (5) < 2(2k) a ~ 1 Z tfc (5) / 'k^ 1 < 

2 a +1 Zt k (5) by definition of T. The rest of the proof that Assumption (H2) 
is fulfilled is left to the reader. 

Let us check Assumption (H3), using Remark 4.1 with R n := R n and 
S n := Z n (4)Z n (5). First, M! 3> M. implies R' t , > Rt n . Second, we need an 
estimate of 



^(4)Z tn (5) 



ZU4)Z'(5) 



<2(ln^M + ln^l 
-\ [n Z'U) +[n Z tn (5) 
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Let us, for instance, upper bound hiZj, (5)/Z tn (b). Assume n> k > Cst 
and let 5 k ■= ^^(6) — Y^(6). The proofs of Proposition 3.1(b) and (c) im- 
ply [using Z tn (5) > Z+(5) > n, Z tn (7) > (1 - e)Z tn (2) > (1 - e)Z tn (5)/e > n 
and n < j 1 "' 6 '" 1 ' 6 ] that 

lnZ tn (5) - Cst(x,v ) 

= y+(4) + y t ;(6) + n(z tn (5)- 1 ) 

= Y+(4) + Y+(6) + 6 k + D(2/Vk) 

= y+(4) + y+(6) + <5 fc + n(3/v / fc) 

and, similarly, 

lnZ£ (5) - Cst(x,« ) = ^' + (4) + & + (6) + 5 fc + D(2/>/fc) 
(recall that A4 and A4' are the same until time i^). Therefore, 

Z', (5) 4 
(39) In < ^(4) - y+(4) + K*(6) - l£(6) + ^. 

Now V/, + (4) < Y^(A) since A4' > A4. Let u n (resp. u' n ) be the nth visit 
time to site 7 for M. (resp. ): 



Z', (7) n Z', (7) 

- A; A; 



>?(6)= E — — ^ E 
fe=i fc=i 



In summary, (39) implies, assuming k > Cst and e < Cst, 

m^< T I<in^!l + ^ + A< ln ^!) + A 

( 5 ) " fc =^t(7)+i k " ^ (7) (7) ^ " (?) ^ 

APPENDIX: GENERAL MARTINGALE RESULTS 

Let us recall the following theorem: The first part is due to Doob, while 
the second part is due to Neveu (see [6], Propositions VII-2.3 and VIII-2.4). 

Theorem A.l. Let (M n ) ng pj be a square integrable martingale. Let 

n 

a n = E((M n+1 - M n ) 2 \F n ) < oo, (M) n = £ a*. 

k=0 

Then, for all r > 1/2: 
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(i) {(M)oo < cx)} C {3 Moo G M/M„ -> M^} a.*.; 

(ii) {(M) oo = cx)}c{M ri = O ((M)y_ 2 1 (ln(M) n „ 1 )0} o.«. 

We make use of the following generalized version of the conditional Borel- 
Cantelli lemma at various steps of the proof. 

Lemma A.l. Let G = (G n )neN be a filtration. Let (£ n )neN [resp. (/9 n )neN] 
be a G-adapted sequence of random variables that take values in IR + and 
are bounded [resp. nondecreasing]. Let (r n ) nG ^* be a sequence of G-adapted 
random sets. Let 

p fc _i=P(r fc |&_i), 

n n 

k=l k=l 

n 



Then: 



(ii) {A^ < 00} c = ; 

(iii) {Lk&PkSk < 00} C {3? n - = 0(1/ VK)}- 

Proof. First observe that 

M n = - $* 

is a martingale and that A n = (M) n _i. This implies claims (i) and (ii), using 
Theorem A.l [note that A n = 0($*), since (£ n )neN is bounded]. 

Let us now prove (iii). Let us define the G-adapted random processes 

n n 
fe=l fe=l 

with the convention that Rq = 0. Observe that i? n is a martingale and that 

00 

(R)oo = ^2Pk$k < OO, 
fc=0 

which implies by Lemma A.l that R n converges a.s. toward a r.v. € K. 
Now, observe that 

n 
fc=l 
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and, therefore, 

oo 

M 00 -M n = ]T (3k-i 2 ( R k-Rk-i) 

k=n+l 

oo 

= E ^k V i - 0k 1/2 ) R k~ /3- l/2 R n = 0(l/y%). □ 

fc=n+l 

The following lemma has some similarity to the conditional Borel-Cantelli 
lemma, although its proof is based on different arguments. Assuming some 
upper bounds on conditional probabilities for events T n , depending on the 
number of times T n has arisen, T n a.s. holds only finitely often. The result 
is used in the proof of Lemma 2.10. 



Lemma A. 2. Let G = (<5 n )neN be a filtration, let (7 n )neN be a G-adapted 
sequence that takes values in R such that liminf 7 n > a.s. and let (r n ) ne ^* 
be a sequence of G-adapted events. For all n G N, let 

T n = sup{k <n s.t. Tfc holds}. 

Then 

(40)|3aGR;,mGN s.t. Vn > m,P(L n+1 |C? n ) < -^-| C jf>r„ <ooj. 

Proof. For all a, e G R+ and m G N, let T a ^ e ^ m be the stopping time 
T a ^ m := inf{n > m s.t. -y n < e or F(T n+1 \g n ) > ar^ Tn /n 1+ >™ }. For all n G 
N, let A^f 4 := r n+i n {T ai£ , m > n} and V a , e ,m = {E^°=i ^A% e > m < °°}- 

Let us prove that, for all a, £ G R!j_ and n > m, f(V a ,e,m\Gn) > Cst(a,e) > 
0. This enables us to conclude. Indeed, suppose this inequality holds. By a 
standard martingale theorem, ^{y a ,e,m\Gn n) ^n— »oo oo I 

h? a ,e, m since V , 6 , m G ^oo- Therefore, ±v a . e . m > Cst(a,e) a.s. and P(V a , £ , m ) = 1 
(for all a, e G R+ and m G N). We deduce that a.s. on {3a, e G R+,m G 
N s.t. T ajE ^ m = oo}, T n only occurs finitely often, which proves the lemma. 

Fix a, e G K_, and m G N. For simplicity, we assume m > 2sup(l,a), 
and 7n < 1 for all n G N [the overestimate of P(r n +i|£7 n ) remains true if we 
replace j n by j n A 1]. Given n>m, let us estimate 

(oo 
n ( A r ,m )' 
fc=n+l 

/ ^ 1 

> exp — 2an lTn 




k=n 



>exp(-^)>0, 
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where we use that 1 — x > exp(— 2x) for all a; £ [0, 1 /2] (with x = ari 1 ^ / k 1+lTn 
an^ 1 < 1/2 since m > 2a) and (n — l)/n> 1/2 (since m > 2). This enables 
us to conclude. □ 
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